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FIRST PRELIMINARY AMENDMENT 



Sir: 



Please ensure that the following amendments have been entered. 
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Serial Number: New 
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In the Specification: 

At page 1, after the Title and before "Field of Invention", please insert the following text: 

— Cross-Reference to Related Application 

This is a Section 35 U.S.C. 371 application from PCT Serial No, PCT/AUOO/00967, filed 
August 14, 2000. - 

At page 9, after line 17 and before line 18, please insert the following new paragraphs: 

— According to a fourth aspect of the invention there is provided a digital video 
management system including: 

a plurality of cameras for providing respective first video signals to a computer 
communications network; 

a video server for linking to the network, receiving the first video signals and being 
responsive to a predetermined schedule for storing on storage media associated with the server at 
least some of the first video signals, wherein the server selectively accesses the stored signals 
and/or the first video signals to provide second video signals; 

at least one client computer terminal for linking to the network for providing the 
predetermined schedule and for receiving the second signals. 

Preferably, the predetermined schedule includes a plurality of time based trigger points and 
the server stores the first images starting at a first predetermined period prior to each point and a 
second predetermined period after each point. More preferably, the predetermined schedule 
includes a plurality of event based trigger points and the server stores the first images starting at a 
first predetermined period prior to each point and a second predetermined period after each point. 
Even more preferably, the system includes a sensor for providing a third signal to the network, 
wherein one of the event based trigger points comprises the third signal falling within a 
predetermined range. 

Preferably also, the predetermined schedule includes a plurality of time based trigger 
points and the server stores the first images starting at a first predetermined period prior to each 
point and a second predetermined period after each point. More preferably, the first and the 
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second predetermined periods are configurable based upon one or more of: on a per camera 
basis; on a per area basis; on an event type basis. 

In a preferred form, the duration of the first and the second predetermined periods are 
configurable. 

Preferably, the system includes a plurality of client terminals and a controller for 
controlling the second signals that are provided to respective terminals. More preferably, the 
terminals provide over the network respective camera control commands to the video server and 
the video server processes those commands and generates control signals that are sent to the 
relevant camera via the network. More preferably, the processing of the commands by the video 
server includes a determination of whether or not the terminal sending the respective command 
has access rights to the relevant camera. 

According to a fifth aspect of the invention there is provided a digital video management 
system including: 

a plurality of cameras for providing respective first video signals to a computer 
communications network; 

a video server for linking to the network, receiving the first video signals and storing on 
storage media associated with the server at least some of the first video signals, wherein the 
server is responsive to a plurality of client account records for accessing the first signals and/or 
the stored signals to selectively produce a plurality of second video signals; and 

a plurality of client computer terminals corresponding to each client access record, the 
terminals being linked to the network for requesting and receiving respective second signals. 

Preferably, at least some of the client account records are changeable via the respective 
client computer terminal. More preferably, the client account records include data indicative of 
the one or more first signals and/or stored signals that the server is responsive to when producing 
the respective second signals. 

Preferably also, the client account records include data indicative of one or more 
predetermined triggers. More preferably, the trigger is one or more of: a predetermined time; a 
predetermined interval; and an event. Even more preferably, the event is predicated by a transducer 
that provides an event signal to the video server via the network. — 
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At page 29, at the beginning of line 1, please insert the following text: 

— (b) The EBI/Plantscape Host is responsible for telling the Camera Manager to 
record video based on events. The Client provides the user interface for the system. This is done 
via the Station software. A safebrowse object is placed within a — 

In the Claims : 

Please cancel claims 2 - 110, without prejudice. 

Please ensure that the following claims 1 1 1 to 126, added by amendment during Chapter 
II under Article 34, are included as part of the pending application, and if not, please add them as 
new claims. 

— 111. A digital video management system including: 

a plurality of cameras for providing respective first video signals to a computer 
communications network; 

a video server for linking to the network, receiving the first video signals and being 
responsive to a predetermined schedule for storing on storage media Eissociated with the server at 
least some of the first video signals, wherein the server selectively accesses the stored signals 
and/or the first video signals to provide second video signals; 

at least one client computer terminal for linking to the network for providing the 
predetermined schedule and for receiving the second signals. 

112. A system according to claim 1 wherein the predetermined schedule 
includes a plurality of time based trigger points and the server stores the first images starting at a 
first predetermined period prior to each point and a second predetermined period after each 
point. 

113. A system according to claim 1 wherein the predetermined schedule 
includes a plurality of event based trigger points and the server stores the first images starting at 
a first predetermined period prior to each point and a second predetermined period after each 
point. 
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114. A system according to claim 2 including a sensor for providing a third 
signal to the network, wherein one of the event based trigger points comprises the third signal 
falling within a predetermined range. 

115. A system according to claim 1 wherein the predetermined schedule 
includes a plurality of time based trigger points and the server stores the first images starting at a 
first predetermined period prior to each point and a second predetermined period after each 
point. 

116. A system according to claim 5 wherein the first and the second 
predetermined periods are configurable based upon one or more of: on a per camera basis; on a 
per area basis; on an event type basis. 

117. A system according to claim 5 wherein the duration of the first and the 
second predetermined periods are configurable. 

118. A system according to claim 1 including a plurality of client terminals and 
a controller for controlling the second signals that are provided to respective terminals. 

119. A system according to claim 8 wherein the terminals provide over the 
network respective camera control commands to the video server and the video server processes 
those commands and generates control signals that are sent to the relevant camera via the 
network. 

120. A system according to claim 8 wherein the processing of the commands 
by the video server includes a determination of whether or not the terminal sending the 
respective command has access rights to the relevant camera. 
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a plurality of cameras for providing respective first video signals to a computer 
communications network; 

a video server for linking to the network, receiving the first video signals and storing on 
storage media associated with the server at least some of the first video signals, wherein the 
server is responsive to a plurality of client account records for accessing the first signals and/or 
the stored signals to selectively produce a plurality of second video signals; and 

a plurality of client computer temiinals corresponding to each client access record, the 
terminals being Hnked to the network for requesting and receiving respective second signals. 

122. A system according to claim 1 1 wherein at least some of the client account 
records are changeable via the respective client computer terminal. 

123. A system according to claim 1 1 wherein the client account records include 
data indicative of the one or more first signals and/or stored signals that the server is responsive 
to when producing the respective second signals. 

1 24. A system according to claim 1 1 wherein the chent account records include 
data indicative of one or more predetermined triggers. 

125. A system according to claim 14 wherein the trigger is one or more of: a 
predetermined time; a predetermined interval; and an event. 

126. A system according to claim 15 wherein the event is predicated by a 
transducer that provides an event signal to the video server via the network. ~ 
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REMARKS 



This application was filed under 35 U.S.C. 371. This National filing is being made after 
preliminary examination under Chapter II. 

The specification and the claims were amended during Chapter II. The amendments to 
the Summery of the Invention and to the Claims are the same as those made during prehminary 
examination in Chapter II, and are being requested again in this First Preliminary Amendment to 
ensure that the amendments were entered during Chapter 11. The amendment to page 29 
reiterates the benefits of the structure and methods described in the adjacent portions of the 
specification and illustrated in the drawings. The text is implicit in the structure and method 
described and illustrated, and no new matter is added. 

With the amendments, claims 1 and 1 1 1-126 are pending in the application. 

Please consider the claims and the rest of the application in view of the foregoing 
amendments and remarks. Early notice of allowance of the claims is respectfiiUy requested. 

Please charge any additional fee that may be due or credit any overpayment to our 
deposit Account No. 50-0655. A duplicate copy of this pleading is enclosed. 



HENRICKS, SLAVIN & HOLMES LLP 

840 Apollo Street, Suite 200 
El Segundo, CA 90245-4737 
310-563-1456 
310-563-1460 (fax) 
ihenricks(S).hsh-iplaw.com (Email) 



Dated: February 12, 2002 
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TITL fe: SYSTEM AND METHOD FOR DIGITAL VroEO MANAGEMENT 
FIELD OF INVENTION 

The present invention relates to digital video management systems, and, in 
particular relates to a digital video management system which provides live digital 
5 video signals from a number of cameras to a number of client terminals, via a 
computer communications network, in real time. 

The invention has been developed primarily for use with digital cameras in 
integrated security and process control environments, and will be described hereinafter 
with reference to these applications. However, it will be appreciated that the invention 
10 is not limited to use in those fields. 
BACKGROUND 

The provision of streamed video data from a transmission point to viewing or 
monitoring computers is dominated by intemet broadcasting systems. Examples of 
this technology include NetShow (TM) by the Microsoft Corporation and RealVideo 

15 (TM) by RealNetwork. Due to the relatively limited bandwidth presently available to 
most users of the intemet, these broadcast systems rely strongly on the use of high 
level compression algorithms. Some systems rely on compression standards such as 
those defined by the various Motion Picture Experts Group ("MPEG") standards. In 
other cases, proprietary standards have been developed that better sxiit the compression 

20 requirements of live, or at least streamed, video. 

Other fields in which streaming video, generally, has been of interest are those 
of industrial control and automation, and security and access control. A typical 
example is a casino, in which intensive surveillance can use over 1,500 cameras 
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monitored by a team of, say, 6 operators. Currently, these highly visually intensive 
applications utilise analog, full bandwidth video and, as required, audio. Any 
recording that takes place is implemented on analog or digital video recorders, the 
tapes or other recording media then being archived for a predetermined length of time 
5 to ensure that they are available if required. Unfortunately, archiving of video-taped 
data in this way is unappealing because it requires an entire dedicated analog 
recording and replay system for multiple chaimels of video. Moreover, location and 
replay of a particular time or event associated with one or more cameras can be 
inconvenient due to the need to retrieve specific tapes and to fast forward and rewind 

1 0 the tapes manually to locate a particular entry points. 

In addition traditional CCTV systems rely on large, expensive matrix switchers 
connected via expensive video cabling to bring CCTV monitoring to operators. 
Integration with security systems is reserved for the top end of the market. These 
systems have been largely inflexible because installing and commissioning a new 

15 camera or operator monitor is expensive, time consuming, and can involve significant 
construction works. 

A significant constraint of the traditional CCTV system is the method of 
recording video to VCR tapes. These devices allow read and write operations, but not 
at the same time. So if a user wishes to view a recently recorded event they must halt 

20 any current recording and rewind the tape before being able to view the incident. The 
only traditional CCTV solution to this problem was a complex method of switching 
recording to standby VCRs that resulted in recordings being spread across several 
tapes. 
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Typical analogue systems are centred around a matrix switcher which provides 
camera switching and control for the system as shown in Figure 1. There are inherent 
disadvantages with this architecture as follows: 

Firstly, star cabling configuration using application specific coaxial cabling. 
5 This is inherently inflexible and costly in that if an additional camera or monitor is 
required, a dedicated cable needs to be installed that connects back to the matrix 
switcher. 

Secondly, significant hardware real estate is required for such matrix switcher 
equipment. 

10 Thirdly, such architectures provide limited recording capability which is 

restricted by the length of VHS tape. By way of example, a typical recording 
configuration would be to connect 16 cameras to a multiplexer, which in tum is 
connected to a video recorder that records in time lapse mode for 24 hours. 

The 16-input multiplexer is capable of real time (25 ^s in PAL format) 

15 recording overall. With 16 cameras being recorded simultaneously, each camera is 
recorded at approximately 1.5 ^s, when recorded on a VCR tape in non time-lapse 
mode. Using a four hour VCR tape in 24 hour time lapse mode, this frame rate 
decreases by a factor of 4 - recording is now at a rate of one frame every four seconds. 
Fourthly, cameras cannot be individually configured with different recording 

20 frame rates. 

Fifthly, the only way to improve the frame rate is to reduce the number of 
cameras or the duration of recording. This of course means either adding fixrther 
VCRs (with a consequent increase in multiplexers, cost and control room real estate) 
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or increasing the frequency of tape changes (which creates more labour for those 
responsible and an increase in storage space required 

Sixthly, recording and playback of a tape cannot be done simultaneously. To 
view a tape that is being recorded, the tape has to be stopped, rewound and played. 

5 Finally, due to the mechanical components of a VCR, maintenance 

requirements are high. 

A feature of streamed internet-based video is that the compression algorithms 
used to minimise bandwidth introduce a delay. The delay can be fixed or variable, 
depending upon the implementation, and can extend to many seconds in duration. 

10 Moreover, internet streaming video transmission standards usually emphasise 
coherency of sound at the expense of video coherence, since humans are more 
susceptible to information loss through interrupted speech than the loss of a few 
fi-ames from full motion video. For example, both NetShow and RealVideo are tuned 
to give priority to the audio stream over the video stream. This is ideal for content 

15 such as news broadcasts, where maintaining an unbroken audio stream is of greater 
relative importance to human comprehension than the quality of the associated video 
stream. However, in the security and process control field, movement can be 
considerably more important than sound. For example, a criminal may take less than a 
second to break a window. If several frames have been dropped to cope with 

20 relatively low available bandwidth, then the crime can be missed. This makes 

NetShow, and RealVideo and similar products designed for intemet video streaming 
unsuitable to the security and process control markets. 



ZL IJ ^^ "^ ^^-^^iP 13 :X 
WO 01/13637 PCT/AUOO/00967 

-5- 

Another issue is that internet broadcasting of live events does not need to be 
absolutely live. In particular, the audience will not be aware if an event has been 
delayed by a few seconds. Both NetShow and RealVideo take advantage of this fact 
to delay broadcast so that the respective systems can determine whether a video stream 
5 to be transmitted can further be compressed. For this reason, both products introduce 
a delay in the order of several seconds. 

By contrast, in a process control environment, video is often used to confirm 
operator control. For example, an operator in a control room can use visual feedback 
from a video camera to enable him to remotely control pouring of steel. It will be 
10 appreciated that any delay between the event occurring and the corresponding video 
reaching the operator controlling the event can be dangerous. 

Similar principles apply to security. A prison guard remotely opening a door 
needs to know immediately if an escapee is hiding behind the door. Delays of several 
seconds in this situation are unacceptable. 
15 It is an object of the invention to overcome or at least substantially ameliorate 

one or more of the disadvantages of the prior art. 

In addition, the present invention has a number of non-limiting advantages, as 
follows: 

Firstly, it provides tight integration with Honeywell's Enterprise Buildings 
20 Integrator (EBI) software to provide significant ease-of-use. The ability to view live 
and recorded video fi:om the same operator stations as used for the security 
management, including new and fiiture stations is a significant advantage. The ability 
to use any event in the system as a trigger for video recording provides you with the 
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ultimate in flexibility and the association of video to system alamis makes it relatively 
simple for ttie user to investigate incidents. 

Secondly, it is flexible. Because the present invention transmits compressed 
video signals via the network it easy to move existing cameras and install new 
5 cameras. New CCTV monitors only require a PC with suitable software and a 
network connection. 

Thirdly, it is cost-effective. By utilising industry standard TCP/IP networking, 
the present invention can share network structures with other corporate groups thus 
significantly reducing the ongoing cost of CCTV system support. This also means 
10 that the cost of adding or relocating cameras is greatly reduced since access to a 
network connection is generally far easier than having to install dedicated cabling 
back to a matrix switcher. Further, the present invention works with standard, open, 
PC and network components and so allows customers to choose their desired 
components. And since pan/tilt/zoom (PTZ) control can be perfonned from EBI, no 
1 5 costly matrix switcher is required. 

Fourthly, the system is open. The present invention uses non-proprietaxy 
hardware to create an open surveillance system. This openness means that a user's 
initial investment is protected and that the system can be cost effectively expanded at a 
later date to easily handle additional cameras, incorporate new technology, or to 
20 handle changes in building use or configuration. 

Fifthly, it is scalable. Because of it*s revolutionary architecture, the present 
invention is capable of supporting both small and large installations of CCTV 
cameras. 
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Sixthly, it provides significant user security. The present invention contains 
operator security features previously only available in high-end security systems like 
Honeywell Enterprise Buildings Integrator (EBI). Security managers can therefore 
ensure that individual users are controlled in what they can see and what they can do. 
5 Seventhly, the system enables intelligent recording. The combination of event 

activated, user activated and scheduled recording means that the user only needs to 
record the video they want. This not only optimises the use of their storage resources, 
it means that they don't need to spend endless hours searching for recorded incidents. 
Eighthly, it includes an advanced search capability. The present invention's 

10 search capabilities use the latest database technologies to ensure the user can quickly 
find and view any incident 

Ninthly, the system provides advanced archiving so the user never loses the 
important data. Data is written to DAT tape or other storage media for long-term 
storage. Users can specify how long each individual section of video will be retained. 

15 Tenthly, it provides smooth playback. The format of recorded video on 

traditional CCTV systems does not have a time base. This means that the playback 
speed of incidents tends to vary based on how busy the recording machine is. The 
recorded video will show a person walking across a field of view at a constant rate as 
slowing down and then hurrying. By using time indexing when storing video, the 

20 present invention is able to replay incidents as they occurred - not in fast or slow 
motion. 

SUMMARY OF INVENTION 
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According to a first aspect of the present invention, there is disclosed a 
digital video management system including: 
a video server; 
a plurality of cameras; and 
5 at least one client computer terminal, all linked via a computer 

communications network, wherein said video server receives video signals from said 
cameras, and provides said video signals to said client, via said network. 
Preferably, said server provides one or more of: 
(a) live video signals; and 
10 (b) previously recorded video signals; 

to said client in real time. 

Preferably, one of said cameras is a recording camera providing live video 
signals to said video server via said network and wherein whilst said video server is 
receiving those live video signals from said recording camera it simultaneously 
15 provides to any client: 

(a) live video signals from said recording camera; and 

(b) video signals which have been previously recorded from said recording 
camera. 

According to a second aspect of the present invention, there is disclosed a 
20 method of managing digital video using a digital video management system including: 
a video server; 
a plurality of cameras; and 
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(AMENDED PAGE) 



at least one client computer terminal, all linked via a computer 
communications network, wherein said method includes the steps of: 

(a) sending video signals from said cameras to said video server; 

(b) providing said video signals from said video server to said client, via 
5 said network. 

According to a third aspect of the present invention, there is disclosed a system 
for low-latency remote video monitoring of one or more areas or processes of interest, 
the system including: 

a plurality of cameras positioned respectively at or adjacent the areas or 
10 processes of interest, each of the cameras outputting a video signal; 

interface means connecting the cameras to a computer communications network, 
for placing the respective video signals onto the computer communications network; 

a first computer server connected to a computer communications network, for 
accepting the video signals from the interface means; and 
15 at least one computer terminal connected to the computer communications 

network for selectively monitoring one or more of the video signals via the first 
computer server. 

According to a fourth aspect of the invention there is provided a digital video 
management system including: 
20 a plurality of cameras for providing respective first video signals to a computer 

communications network; 

a video server for linking to the network, receiving the first video signals and 
being responsive to a predetermined schedule for storing on storage media associated 

with the server at least some of the first video signals, wherein the server selectively 
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accesses the stored signals and/or the first video signals to provide second video 

signals; 

at least one client computer terminal for linking to the network for providing 
the predetermined schedule and for receiving the second signals. 
5 Preferably, the predetermined schedule includes a plurality of time based trigger 

points and the server stores the first images starting at a first predetermined period prior 
to each point and a second predetermined period after each point. More preferably, the 
predetermined schedule includes a plurality of event based trigger points and the server 
stores the first images starting at a first predetermined period prior to each point and a 

10 second predetermined period after each point. Even more preferably, the system 

includes a sensor for providing a third signal to the network, wherein one of the event 
based trigger points comprises the third signal falling within a predetermined range. 

Preferably also, the predetermined schedule includes a plurality of time based 
trigger points and the server stores the first images starting at a first predetermined 

15 period prior to each point and a second predetermined period after each point. More 
preferably, the first and the second predetermined periods are configurable based upon 
one or more of: on a per camera basis; on a per area basis; on an event type basis. 

In a preferred form, the duration of the first and the second predetermined 
periods are configurable. 

20 Preferably, the system includes a pliorality of client terminals and a controller for 

controlling the second signals that are provided to respective terminals. More preferably, 
the terminals provide over the network respective camera control commands to the video 
server and the video server processes those commands and generates control signals that 
are sent to the relevant camera via the network. More preferably, the processing of the 

AMENDED SHEET 
IPEA/AU 



Received 04 June 2001 



-9/2- 

commands by the video server includes a determination of whether or not the terminal 
sending the respective command has access rights to the relevant camera. 

According to a fifth aspect of the invention there is provided a digital video 
management system including: 

a plurality of cameras for providing respective first video signals to a computer 
conraiunications network; 

a video server for linking to the network, receiving the first video signals and 
storing on storage media associated with the server at least some of the first video 
signals, wherein the server is responsive to a plurality of client account records for 
accessing the first signals and/or the stored signals to selectively produce a plurality of 
second video signals; and 

a plurality of client computer terminals corresponding to each client access 
record, the terminals being linked to the network for requesting and receiving 
respective second signals. 

Preferably, at least some of the client account records are changeable via the 
respective client computer terminal. More preferably, the client account records 
include data indicative of the one or more first signals and/or stored signals that the 
server is responsive to when producing the respective second signals. 

Preferably also, the client account records include data indicative of one or more 
predetermined triggers. More preferably, the trigger is one or more of: a predetermined 
time; a predetermined interval; and an event. Even more preferably, the event is predicated 
by a transducer that provides an event signal to the video server via the network. 
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Other aspects and features of the invention will become apparent from reading 
the following detailed description of preferred embodiments in conjunction with the 
attached drawings. 

BRIEF DESCRIPTION OF DRAWINGS 

Preferred embodiments of the invention will now be described, by way of 
example only, with reference to the accompanying drawings, in which: 
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Figure 1 is a schematic diagram showing components in a prior art analogue 
Closed Circuit Television ("CCTV") system; 

Figure 2 shows a first embodiment of a system for low-latency remote video 
monitoring of one or more areas or processes of interest, in accordance with the 
5 present invention; 

Figure 3 shows an alternative embodiment of the system shown in Figure 2, 
the alternative system also being in accordance with the invention; 

Figure 4 shows another ahemative embodiment of the system shown in 
Figures 2 and 3, the embodiment of Figure 4 also being in accordance with the 
10 invention; 

Figure 5 is a schematic diagram showing the file structure of a video server 
and client, forming part of a system according to the invention; 

Figure 6 is a screen dump of a sample client display screen showing a fi-ame 
captured fi^om a single camera and displayed on a client in a system according to the 
15 invention; 

Figure 7 shows the display screen of Figure 6 showing multiple fi-ame captures 
fi*om multiple cameras; 

Figure 8 is a block diagram of a system such as that shown in any of Figures 2 
to 4, setting out the steps for viewing live camera output; 
20 Figure 9 shows a block diagram similar to that of Figure 8, setting out the steps 

for user-activated recording; 

Figure 10 shows a block diagram similar to those of Figures 8 and 9, setting 
out the steps for event-activated recording; 
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Figure 1 1 is a block diagram showing implementation of camera control; 
Figure 12 is a block diagram showing implementation of a joystick client for 
assisting camera control; 

Figure 13 is a block diagram showing the steps for implementing scheduled 
5 recordings; 

Figure 14 is a functional diagram of a schedule manager for implementing 
schedule management as shown in Figure 13; 

Figure 15 is a block diagram illustrating the Viewing of Recorded Video; 

Figure 16 is a functional diagram of an archive manager; 
10 Figure 17 is a block diagram illustrating Event Activation (EBI version); 

Figure 18 shows the relationship between the camera manager and other 
controls and managers on the video server; 

Figure 19 is a block diagram showing implementation of an audit log; 

Figure 20 is a block diagram showing implementation of an engineering log; 
15 Figure 2 1 is a block diagram illustrating the Changing of Camera Settings; 

Figure 22 shows a typical view of a client display screen, showing live video 
firom a single camera; 

Figure 23 shows a client display screen showing a Video Clip Review screen; 

Figure 24 shows a client display screen showing a Recording Screen; 
20 Figure 25 is a block diagram illustrating key interactions between the 

components of the present invention. 

Figure 26 is an HMI System Block diagram; 

Figure 27 is a block diagram illustrating an HMI Layout; 
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Figure 28 is a table showing the preferred Menu options; 
Figure 29 is a block diagram illustrating Video Player Control; 
Figure 30 is a screen dump of a client display screen showing a Video Player 
in Live mode; 

5 Figure 31 is a screen dump of a cHent display screen showing Video Player in 

Playback mode; 

Figure 32 is a screen dump of a client display screen showing the Event 
Viewer Control; 

Figure 33 is a block diagram illustrating the many-to-many relationship 
1 0 between clips and segments; 

Figure 34 is a block diagram illustrating Point Control; 
Figure 35 is a block diagram illustrating the Component interaction between 
web pages and the business objects; 

Figure 36 is a block diagram illustrating Business objects instantiated by client 

15 side scripts; 

Figure 37 is a block diagram illustrating Web page interaction with the Active 
Video Player; 

Figures 38 to 45 do not exist. 

Figure 46 is a table illustrating Security level Permissions; 
20 Figure 47 is a table illustrating Camera Operations; 

Figure 48 is a block diagram illustrating the Security System Interface; 
Figure 49 is a screen dump of a sample chent display screen showing the Live 
Video Settings of the preferred embodiment; 
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Figure 50 is a screen dump of a sample client display screen showing the 
Camera Recording Details of the preferred embodiment; 

Figure 51 is a screen dump of a sample client display screen showing the 
Recording Schedule Configuration of the prefOTcd embodiment; 
5 Figure 52 is a screen dump of a sample chent display screen showing the Add 

a New Camera screen of the preferred embodiment; 

Figure 53 is a screen dump of a sample client display screen showing the Basic 
Search Of Recorded Video screen of the preferred embodiment; 

Figure 54 is a screen dump of a sample client display screen showing the 
10 Advanced Search Of Recorded Video screen of the preferred embodiment; 

Figure 55 is a screen dimip of a sample client display screen showing the 
Search Results screen of the preferred embodiment; and 

Figure 56 is a screen dump of a sample client display screen showing the 
Camera Group Settings screen of the preferred embodiment. 
15 DETAILED DESCRIPTION 

Referring to the drawings, and the embodiments shown in Figure 2 in 
particular, a system for low-latency remote video monitoring in one or more areas or 
processes of interest includes a plurality of cameras 2. Each of the cameras 2 is 
positioned respectively at or adjacent an area or process of interest (not shown). 
20 Interface means in the form of respective camera streamers 4 connect the 

cameras 2 to a computer communications network in the form of a TCP/IP network 6. 
In the preferred embodiment, the TCP/IP network takes the form of an ethemet 
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connection, although any suitable local area network ("LAN"), wide area network 
("WAN") or remote communications network such as the Internet can be utilised. 

A first computer server, hereinafter referred to as video server 8, is connected 
to the TCP/IP network 6 by a means of a suitable interface. The interface can take the 
5 form of a network interface card (now shown) installed within the video server 8 to 
enable data to placed onto and removed from the TCP/IP network 6 by the video 
server 8. 

Also provided is a computer terminal in the form of a client computer 10, that 
is also connected to the TCP/IP network 6 for communication therewith. As with the 

10 video server 8, a suitable interface means is provided to enable the client computer 10 
to place data on, and remove data from, the TCP/IP network 6. 

In the preferred embodiment, both the video server 8 and the client computer 
10 take the form of EBM-Compatible personal computers ("PCs"). In that case, it is 
preferred that the video server 8 use the Microsoft NT operating system, whilst the 

15 client computer 10 can use Windows NT, Windows 9X or Windows 2000, for 
example. It will be appreciated that other operating platforms, such as a Sparc- 
stations or Macintosh computers, and different operating systems, such as Unix or the 
Macintosh OS can be used, depending upon the application or existing network 
arrangement, 

20 The cameras 2 can be based on any suitable television format or resolution, 

including black and white, NTSC colour, PAL colour or S-CAM colour. Typically, 
the output from each camera will take the form of an analog output from the cameras. 
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supplied directly to their respective camera streamers 4. However, cameras with 
compressed or uncompressed digital outputs can also be used. 

Each camera streamer 4 receives the analog signal from its respective camera 2 
and converts it to a predetermined digital format, which is then packetised into a 
5 suitable TCP/IP format. The packetised data is then placed onto the TCP/IP network 
6. 

In one embodiment, the packetised data streamed onto the TCP/IP network 6 is 
in a compressed format. The compression can take place in a number of ways. For 
example, the camera 2 itself can digitise and pre-compress the video stream, thereby 

10 avoiding the need for the corresponding camera streamer 4 to digitise or compress the 
video. Altematively, the camera streamer 4 can itself perform compression of the 
digitised video. The compression can be of any suitable form, including any of the 
MPEG standards. However, a standard that is configured specifically to smooth 
streaming of video data standard, is more desirable. Examples of suitable 

15 compression schemes and standards will suggest themselves to those skilled in the 
relevant art. 

Referring to Figure 5, there is shown an architecture of both the video server 8 
and the client computer 10. The video server 8 includes software modules including a 
camera manager 12, a software video player, both operating on a Windows NT server 
20 platform. In the embodiment shown, the video server 8 also includes storage means in 
the form of a hard disk drive 16 for storing the streamed video taken from the TCP/IP 
network 6. It will be appreciated that the hard disk drive 16 can either be on the same 
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physical computer as the other software components, or can be placed on a different 
physical computer connected by the same TCP/IP network 6. 

It will be appreciated that suitable software video players will suggest 
themselves to those skilled in the art. 

5 The client computer 10 includes an operating system in the form of Windows 

2000, an intemet browser in the form of Intemet Explorer V5 20, and a video player in 
the form of a software video player 22 for interfacing with Intemet Explorer V5 20. It 
will be appreciated that many of the other features discussed in relation to the 
preferred embodiments are implemented in other software modules, the 

10 implementation of which will be readily appreciated by those skilled in the art. 

During normal usage, each of the cameras 2 is powered up, and directed at an 
area or process of interest. For example, one or more of the cameras 2 can be 
concerned with security, and might therefore be pointed at an entrance to a building or 
within a foyer. Alternatively, cameras 2 can be positioned to view critical points in 

15 production processes to allow the operation thereof to be monitored. 

Figure 6 shows a screen capture of the front end of a Human Machine Interface 
(HMI) client 26 running on the client computer 10. The HMI clients 26 runs in 
conjunction with software video player 22 with Intemet Explorer 20 running on the 
client computer 10. Once the operator has requested live video from a particular 

20 camera 2 via the HMI client 26 a request is passed to the camera manager 12. In 

response to the request, the camera manager 12 broadcast a stream of live video onto 
the network addressed to the appropriate client computer 10. The software video 
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player 22 receives the suitably addressed video stream from the video server 8, and 
displays it to the operator. 

Figure 6 shows a view presented to an operator of the HMI display of client 
computer 10. In this particular case, an employee at a work station. The operator is 
5 able to choose from other cameras 2 by means of a camera menu 24. Figure 8 shows a 
block diagram of the control paths used whilst an operator is viewing live camera 
output. 

In the preferred embodiment, other information regarding the video stream is 
sent to the software video player 22 and HMI client by the camera manager 12. For 

10 example, details such as the camera status (eg. whether the streaming video selected is 
currently being recorded), the operator currently in control of the camera and the 
expected duration for which the present operator will remain in control. 

At an arbitrary time, usually in response to an incident shown in the streaming 
video, the operator can request that the currently displayed video be recorded. This is 

15 achieved by pressing the record button 28 on the front end of the HMI client 26. In 
response to pressing the record button 28, the software video player 22 sends a request 
to record video to the camera manager 12, as shown in Figure 9. The camera manager 
12in turn causes the video stream from the active camera to be recorded onto the hard 
disk drive 16. In the preferred embodiment, information regarding the record request, 

20 such as the camera name, the name of the user requesting the recording and the time of 
recording are also written to the video server database. Once recording of the video is 
no longer required, the user can press the stop button 30 on the front end of the HMI 
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client 26. Preferably, at this stage, further information such as the duration of the 
recorded video, is also written to the hard disk drive 16. 

In a particularly preferred embodiment of the invention, and as shown in 
Figure 2, one or more controllers 32 are connected to the network for conmiunication 

5 with the system 1 . The controller can take the form of, for example, an interface for 
one or more sensors, such as PIR detectors, smoke sensors, card readers or any other 
security or condition detecting transducer. The controller takes the output Gcom the 
respective transducers and converts them into a suitable TCP/IP protocol to be placed 
on the TCP/IP network 6. 

10 In the usual implementation of the invention, a security or process control 

server 34 is provided. Examples of suitable servers are the Plantscape and EBI 
servers, both developed and licensed by the applicant. It will be appreciated, however, 
that the security or process control server may need to be modified from its standard 
form to interface correctly with the video server. As shown in the embodiment of 

15 Figure 2, the security or process control server 34 can share a physical computer with 
the video server 8. However, as shown in other embodiments such as those of Figure 
3 and 4, the security or process control server 34 is desirably run on separate computer 
hardware. 

The security or process control server 34 is configurable by an operator to 
20 monitor the controller 32, and any other controllers of interest. In the event of an 

alarm or the detection of any other event preselected by the operator of the security or 
process control server 34, an event handler 36 instructs the camera manager 12 on the 
video server 8 to commence recording. In the preferred form, the camera manager 12 
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has access to data setting on the association between one or more cameras 2 and the 
event or alarm indicated by the event handler 36. In this case, the camera manager 12 
selects the appropriate camera or cameras 2 and causes the video streams they provide 
to the network to be recorded to the hard disk drive 16. 

5 In each of the recording cases, it is desirable that the option be provided to set 

a video buffer of some predetermined length. For example, by setting, say, a ten 
second video buffer, recording of a particular video stream in response to either 
operator command or an event notification jfrom the event handler 36 results in the 
recording often seconds worth of video prior to the recording being requested. This 

10 enables an operator reviewing the recorded video to ascertain conditions or events 
prior to that causing the recording to be effected. Moreover, since the event will 
usually have happened inmiediately before recording commences, the buffer enables 
the event itself to be recorded for later review. 

Another way in which recording can take place is by means of scheduled 

15 recordings, as best shown in the block diagram of Figure 13. An operator can 

schedule a record request through a schedule manager 38 accessible via the front end 
of the mvn client 26. The schedule manager 38 is responsible for recording the 
request in an appropriate form, and then requesting that the camera manager 12 
commence recording at an appropriate time. 

20 The schedule manager 38 is a process running on the video server. It polls the 

video server database periodically (every minute in the preferred embodiment) and 
caches a list of record requests for that minute. Since, in the preferred form, schedule 
recordings are accurate to within one minute, this list will simply contain the names of 
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cameras 2 that require video capture. The recordal requests for these cameras 2 are 
sent to the camera manager 12, which writes the appropriate video streams onto hard 
disk drive 16. Relevant details about the recorded video will also be written onto the 
database by the camera manager 12, as discussed above. 
5 Figure 14 shows a fiinctional diagram of the schedule manager 38. The 

schedule manager 38 runs as a Windows NT service, and is responsible for scheduled 
operations. The schedule manager has three main functions, being: 

administration and scheduled recording requests; 

scheduling archiving of video files; and 
10 scheduling deletion of video files firom archives. 

The schedule manager 38 queries the server database each minute for 
recording requests that occur in the current minute (or in previous minutes where they 
are not marked as underway or complete). The schedule manager 38 informs the 
camera manager 12 to start recording for each recording request due in that minute. In 
15 the preferred form, the schedule manager 38 also provides the camera manager 12 
with a camera identification code, a required fi-ame rate and a recording duration. 

Each hour, the schedule manager 38 queries the database for any video files 
where the archived date has passed and where a "DoArchive" flag is set. The 
"Do Archive" flag ensures that video clips that are of immediate or on-going interest 
20 are archived, to ensure that they are available in the fiiture. The schedule manager 38 
then instructs an archive manager module 40 to archive each file in its list. The status 
of the file is then updated to "Archiving in Progress" until the archiving operation is 
complete. 
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Also each hour, the schedule manager 38 queries the database for any video 
files whose delete date has passed and for which a "DoDelete" flag is set. Again, the 
"DoDelete" flag ensures that only those files that are intended to be deleted are in fact 
removed firom the database. The schedule manager 38 then requests that the archive 
5 manager 40 delete each of those files for which deletion is scheduled in the current 
hour. 

Figure 16 shows a functional diagram of the archive manager 40. Within the 
video server, the archive manager selectively communicates with the schedule 
manager 38, the camera manager 12 and the video server database. Requests from the 

10 schedule manager 38 to the archive manager 40 will be for archiving or deletions, 
whilst requests firom the camera manager 12 will be for restoring. 

In response to archiving request, the archive manager 40 queries the video 
server database for the duration of the video data in which the archiving request is 
interested. If necessary, the video segment will be stripped firom the physical video 

15 file on disk and copied to a separate file for archiving. 

This may occur if, for example, a physical video file contains two or more 
overlapping video events that have different archiving requirements. A file may 
contain a period of scheduled recording that is due to be archived, whilst an event that 
needs to remain accessible on-line occurs in the middle of the recording. In this case, 

20 the physical video file is split into two, with the video on either side of the event being 
stripped &om the on-line file and copied to a separate file for archiving. The video 
server database is then updated with the new file locations for each video clip affected. 
The archive manager 40 then instructs Windows NT 5 Removable Storage Manager to 
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mount an appropriate media. The Window NT 5 removable storage manager is well 
know to those skilled in the art, and so is not discussed in detail. 

An alternative embodiment of the system shown in Figure 2 is shown in Figure 
3. In the Figure 3 embodiment, features in common with those of the Figure 2 

5 embodiment are indicated with like numerals. The Figure 3 embodiment differs from 
the Figure 2 embodiment in a number of ways. The first of these is that the video 
server 8 is hosted on a separate computer from the other process control or security 
server 9. The system is implemented like this for a number of reasons, but is 
particularly concerned with enabling the video server 8 to service a greater nxmiber of 

10 cameras. Another major difference is the provision of a network bridge 42 linking a 
first segment 44 and a second segment 46 of the TCP/IP network 6. The cameras 2 
and the video server 8 communicate directly with the second segment 46, whilst the 
client computers 2, the process or security server 9, and various transducers 48 
communicate with the first segment 44. It will be appreciated by those skilled in the 

15 art of network design that this arrangement limits the network traffic generated by the 
various video signals from the cameras 2 to the second segment 46. The only video 
signal data that will reach the first segment 44 is that which is supplied from or 
directed by the video server to one or more cHent computers 10, in response to 
requests from those client computers 10 or alert conditions. 

20 Another, still more complicated embodiment is shown in Figure 4, in which 

there is shown an implementation having integrated facility management (security, 
etc) and process control. In this case, the video aspects of the system are integrated 
with process control, security and image processing. Again, network bridges 42 are 
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used to link first, second and third segments (designated 44, 46 and 47, respectively) 
of the TCP/IP network 6. The various client machines 10 are able to access the 
facility management server 52, the process control server 54 and the various video 
servers 8, depending upon the access rights granted to their respective operators. 
5 The use of multiple video servers 8 allows for a correspondingly larger number 

of cameras. Larger networks and installations requiring more cameras can be 
implemented simply by scaling the number of video servers and network segments. 
Naturally, there will be some restrictions on the ultimate size of the network and the 
number of servers and cameras. These restrictions will be appreciated by those skilled 
10 in the art. 

In the Figure 4 embodiment, image processing is implemented on a separate 
image processing computer 56 connected to the TCP/IP network 6. The types of 
processing undertaken are selected on the basis of the requirements of the system as a 
whole. For example, video related to perimeter management can be processed for 

15 image recognition purposes. Preferably, the image recognition data is recorded with 
the video details on the video database. 

The image recognition data can also be supplied to the security or process 
control servers and used as inputs to their software routines or at least recorded as part 
of security logs. If, for example, a camera is used to inspect visitors approaching a 

20 reception area, the image processing computer 56 can be used to attempt to recognise 
each visitor. The resultant data can be used in many ways. It can be forwarded to the 
security server to ascertain whether the person has security access, or if there is a 
pending security issue related to that person. A comparison can be made with other 
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security access data, such as entry codes and the use of security cards and transducers, 
to ensure consistency between the person's appearance and their identity as evidenced 
by other security devices and procedures. 

Image recognition can also be used to process video from specific process 
5 control environments. The processed video can be, for example, colour or contrast 
filtered, sharpened or blurred, in any combination, and the output used as an input to 
the security server. In this way, process conditions and alarm notifications can be 
raised based on the processed video. The conditions and notifications can also be 
based on combinations of existing feedback data used in security management and 
1 0 process control . 

In the preferred form, the output of the image processing computer 56 is in the 
same format as that of other camera streamers 4. 

The following paragraphs provide a further description of a number of the 
more significant features of the preferred embodiment of the present invention. 
15 Live video can be viewed at fiill motion and with insignificant compression 

delay from any EBI client 

Camera PTZ control is available from any EBI client using either a standard 
Windows pointing device such as a mouse or touch screen, or with a commercial 
joystick for greater user feedback. 
20 Video recording can be activated by one or more of: 

(a) Events and alarms generated by EBI can activate video recording on 

the present invention. Video associated with the alarms and events can 
include video recorded prior to the alarm or event 
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(b) The user viewing an incident. When the user sees an incident they can 
record the incident including an amount of pre-recorded video so that 
the actual incident is not lost. Users can also add notes to the captured 
video. 

5 (c) Schedules that can be one-off and recurring. This ensures an efficient 

use of the recording resources. 
Tight integration with EBI allows alarms and events from those systems to 
activate video recording on the present invention. Video associated with the alarms 
and events can include video recorded prior to the alarm or event so that a user can see 
10 what caused the incident as well as the aftermath. The alarm and event management 
capabilities of EBI bring a previously unavailable power of alarm and event condition 
determination to CCTV video recording. 

Time indexed video storage ensures smooth playback and accurate retrieval. 
Archiving to both single tape units and sophisticated robotic multiple tape 
1 5 units ensure that only important video is marked for long term storage, and that it is 
subsequently never lost. 

User security assists users to perform their jobs efficiently and within their 
areas of expertise and authorisation. 

Quad views allow a user to look at up to four cameras at once. The individual 
20 cameras within the quad view can be cycled to other cameras so that there are no 
limits on the number of cameras that can be viewed. 

Multiple Monitor Support allows a user to view and control multiple video 
monitors from a single keyboard/mouse/joystick. With this feature you can create an 
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advanced security control room, to run your surveillance operations. 

EBI custom schematics allow live video to be inserted in custom schematics 
on EBI systems using the Honeywell Display Builder. 

The network-based architecture of the present invention brings multiple 
5 benefits. It allows the system to leverage existing network investments, making the 
present invention both cost-effective and flexible. Processing power is moved to the 
camera and the client thus allowing the Video Server to support more cameras at a 
previously unavailable video quality. 

Figure 22 shows a tjrpical view of a client display screen, showing live video 
10 from a single camera. From this screen, the operator can select a camera to be viewed, 
initiate real-time recording manually and perform all pan/tilt/zoom functions. 

Figure 23 shows a client display screen showing a Video Clip Review screen. 
The operator can search for a video clip using many different parameters. Once a clip 
is selected, the operator can review the footage at any desired speed. 
15 Figure 24 shows a client display screen showing a Recording Screen. 

Recording can be initiated by an occurrence of any alarm or event in the EBI system; 
on a time schedule (either one-off or recurring) or manually by the operator. 

The following paragraphs provide a further detailed description of the system 
design of the preferred embodiment of the present invention. Throughout the 
20 following description the preferred embodiment of the present invention is referred to 
as the "Avalon" system. 

In this description, the following acronyms have the following meanings: 
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IVfF Aiviivn 




iviicroson Aciive ocrver r^age 


rllVll 


JnUITlall iVLaCiiine InicriaCC 


HSC 


Honeywell Software Centre 


IE 


Microsoft Internet Explorer 


ns 


Microsoft Internet Information Server 


NT 


Windows NT Operating System 


ODBC 


ODBC, Open Database Connectivity. An open standard for 




database conununications 


JvUo 


xvemoie uma oervice 




Microsoft Transaction Server 




/\ciiveyw. uaia wojecis 


fps 


Frames per second 


A Tin 


/waion jDusiness ^Djecis 




\_^omponeni ^Djeci iviouei 




j-/iounDULcu, v^omponeni wDjeci ivioaei 


XVOiVX 




ONV 


Opennet View 


PTZ 


Pan-Tilt-Zoom 


SQL 


Structured Query Language 


SCAN 3000 


Supervisory Control and Networking System developed by HSC 


XSM 


Excel Security Manager system developed by HSC 
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XFi 


Excel Facility Integrator system developed by HSC. 


IPS 


Integrated Personal Station. Suite of GUI applications developed 
by HSC for use with SCAN 3000/XSM/XFi. 


RTU 


Remote Terminal Unit. Device abstraction used in SCAN 
3000/XSM/XFi as a container for points. 


API 


Application Programming Interface 


PAD File 


Point Address Definition file. Used to store lists of point 
addresses for points which have been built using the point build 
utility. 



Figure 25 is a block diagram illustrating key interactions between the 
components of the present invention. In that figure it can be seen that the video server 
is responsible for streaming and recording video fi'om the camera streamers. The data 
server is responsible for storing the configuration and operational data needed for 



5 operation of Avalon. All data is stored within a Microsoft SQL server 7.0 database. 
The web server is responsible for: 

(a) Serving up the web pages to the Avalon web site; 

(b) Video Schedules; and 

(c) Hosting the Business Object in MTS. 

10 The Web Server plays another role as the Primary Camera Manager. All 

connections to Cameras are via the Primary Camera Manager that resides on the Web 
Server. The effect of this is 

(a) Access to Camera Manager fi-om Business Objects and ASP can be via 
COM; and 
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particular display page within stations which navigates to the Avalon Web site. The 
majority of Avalon cUent software is downloaded from the Web Server when required. 

Figure 25b is a block diagram illustrating the viewing of live video using the 
present invention. From the HMI a user requests live video from the Primary Camera 
5 Manager on the Web Server. This request is passed to the Video Server that has the 
camera. The Camera Manager on this Video Server multicasts a stream of live video 
onto network. The video player picks up the network traffic corresponding to the user 
request and displays it on the screen. 

Information regarding the yideo stream is propagated by the camera manager. 
10 This includes details such as the camera status (e.g. whether video is currently being 
recorded), the operator currently in control of the camera and for how long the 
operator will remain in control. 

All Camera status events are passed via the Camera Status object. 
Recording Video. There are three methods of recording video: 
15 (a) A user can request currently viewed video to be recorded via the HMI 

by pressing the "Record" button on the video player; 

(b) PlantScape/EBI alarms and events trigger the recording of video; or 

(c) A user can schedule a recording to take place at a certain date and time. 
User Activated Recording. Referring to the block diagram illustrating User 

20 Activated Recording shown in Figure 26, it can be seen that pressing the "Record" 
button on the active video player (within the HMI) will send a request to record video 
to the camera manager. The camera writes the video stream to the Data Storage 
Device. Information regarding the record request such as the Camera Name, User 
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Name of the user who requested the recording and the Recording Time will also be 
written to the Data Server. After video is recorded, further information about the 
recorded video such as the duration of recorded video is also vmtten to the Data 
Server. 

5 Event Activated Recording. Referring to the block diagram illustrating Event 

Activated Recording of Figure 27 it can be seen that when a PlantScape or EBI point 
that requires video capture goes into alarm, the host server will invoke an event 
handler process. In one embodiment this is an appUcation process activated via the 
normal LRN method. 

10 The event handler process will send a record request to the Camera Manager. 

The camera will write the video stream to the Data Storage Device. Information such 
as *'Point ID" and "Host Name" will also be sent to the Camera Manager. This 
information is recorded along with other details of the recorded video to the Data 
Server. 

15 Scheduled Recording. Referring to the block diagram illustrating Scheduled 

Recording of Figure 28, it can be seen that a user can schedule a record request via the 
HMI. These record requests are entered into the database. It is the Schedule Manager 
that is responsible for notifying the Camera Manager that a recording is to take place. 
The Schedule Manager is a process running on the Web Server. It polls the 

20 database every minute and caches a list of record requests for that minute. Since 
scheduled recordings are accurate to the minute, this list will contain the names of 
cameras that require video capture. The record requests for these cameras are sent to 
the Camera Manager and the Camera Manager writes the appropriate video streams to 
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the Data Storage Device. Relevant details about the recorded video are also written to 
the database by the Camera Manager. 

Viewing Recorded Video. Referring to the block diagram illustrating the 
Viewing of Recorded Video in Figure 29, it can be seen that the viewing of recorded 

5 video is essentially the same process as viewing live video except that the Camera 
Manager obtains the video stream fix>m Disk Storage Device instead of the camera 
source. The Video Player requests video by sending details such as "Camera Name", 
"Clip Date/Time" to the Camera Manager. The Camera Manager then reads the clip 
from the Disk Storage Device and streams the video stream to the requesting client via 

1 0 a point-to-point TCP/IP connection. 

Video Recordings can be access from the Recordings tab for a Camera or via 
the Searching. Both these pages contain a Grid Control that displays all the relevant 
recordings. The Grid control is populated by Business Objects and RDS. 

Changing Camera Settings. Referring to the block diagram illustrating the 

15 Changing of Camera Settings of Figure 30 it can be seen that modifications to data in 
the camera settings page or the recording presets page will commit the new changes 
immediately. Prior to updating the information, the business objects will check the 
viability of the new changes. If there is a conflict in the new changes, the business 
objects will report an error to the client and no changes are committed. If the new 

20 settings do not produce any conflicts, the business objects will write the new changes 
to the video server database. The Camera Manager is notified of the change. 

Security Integration. Each component in the system requires correct launch 
and access permissions to other components in the system for it to work correctly and 
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to deny permission to clients which do not have authority to use the system. To do 
this, the system components are tightly integrated with NT, MTS and SQL security. 

All HMI clients which require access to the Avalon system must be in the 
"DVS Users" NT group. The business objects only provide launch and access 
5 permissions to these users. In practice, the "DVS Users" group will contain users in 
the domain. 

The business objects will in turn run as "DVS Manager" which is an NT user 
who has access to the database. The SQL Server database will use integrated security 
and only allow access to the database to users in the group "DVS Database." "DVS 
10 Manager" is one of these users. 

Camera Manager and Schedule manager both require access to the database 
and therefore run as *T)VS Manager." The EBI components run as "mngr" and also 
require access to the Avalon database. Hence "mngr" is in the "DVS Database" NT 
Group. 

15 When business objects are instantiated from client script on a web page using 

the RDS.Dataspace object, their credentials are passed to the web server and then to 
the business objects. Hence, from the business objects point of view, the identity of 
the person who accessed it is the user logged on to the client machine. 

This is the same for server scripts only if NT Challenge/Response 

20 authentication is used. If we allow anonymous access, the web server will act as 

IUSR_machinename. If IUSR_machinename is not in the "DVS Users" NT group the 
operation will fail. 

To provide security at the business objects level, the "DVS Users" MTS role is 
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created. This role will only contain the "DVS Users" NT Group. 

In a similar way, SQL will have a "DVS Users" role which will only contain 
the "DVS Database" NT Group. 

The following paragraphs describe the functions performed by each design 
5 component (block) identified in the preceding paragraphs. 

Client. The client consists of the following components: 

(a) HMI; 

(b) Video Player Control; and 

(c) Camera Control. 

10 Human Machine Interface (HMI). The Human Machine Interface (HMI) is 

preferably implemented as a series of web pages. Its main function is to provide a 
graphical user interface to the core aspects of the Avalon project. It is through the 
HMI that users can: 

(a) Configure the Video Server Database; 

15 (b) Request live video from a particular camera; 

(c) Search and view recorded video clips; 

(d) View camera groups and camera tours; 

(e) Configure cameras, camera groups and camera tours; and 

(f) Perform administration tasks. 

20 The web pages that foiiii the HMI also serve as a container for ActiveX 

controls such as the tree view control and active video player. 

The underlying components in a web based application is the web server 
(Internet Information Server) and the client browser (Internet Explorer). This 
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Structure is shown in the HMI System Block diagram of Figure 26. As seen in that 
figure, the layout of the HMI may be broken down into four sections: a navigation 
section, a header details section, a tab section and a main frame. This is depicted in 
the block diagram of Figure 27. As illustrated, the navigation section provides the 
5 user with the ability to navigate to different functional areas of Avalon. It consists of 
a main menu broken down into submenus depending on the functionality. 

The navigation frame also houses the active tree view control used to navigate 
through the existing cameras. The tree view control displays a list of available 
cameras that the user may select to view. This tree control also indicates whether a 
10 camera is in one of three states: 

(a) Recording; 

(b) OK (Camera is available); 

(c) Not OK (Camera is disabled, cannot connect - error status is shown in 
the HMI). 

15 The preferred menu and submenu options available in the navigation frame are 

detailed in the table of Figure 28. 

Header Details. The header details section provides details about the page the 
user is currently viewing. These details could also include details about a camera, a 
camera group or camera tour if these were selected. 
20 Main Frame. The main frame comprises of web pages that provide the 

interface to the functionality of Avalon. These pages change depending on the 
selection made by the user in the navigation frame. 

The main frame preferably includes web pages that provide functionality to: 
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(a) View live video; 

(b) View Camera Group; 

(c) View Camera Tour; 

(d) View video clips; 

5 (e) Add/Modify camera settings; 

(f) Add/Modify record settings; 

(g) Add/Modify recording schedules; 

(h) Add/Modify camera group settings; 

(i) Perform an advanced search; and 
10 0) Perform a basic search. 

Live Video. The live video page contains a single video player with 
functionality to allow a user to: 

(a) View a camera; 

(b) Record live video; 
1 5 (c) Take a snapshot; 

(d) Search for recent recordings available for the selected camera; 

(e) Control a camera; and 

(f) Disable a camera. 

To disable a camera, the HMI contacts business objects which in turn ask the 
20 camera manager to disable a camera. When a camera is disabled, there is no 

streaming of live video and any associated recordings at that time will cease. When 
the user re-enables a camera, it is up to the HMI to initiate a request to the database 
manager to reconnect to the camera. 
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Camera Settings. When a user modifies the camera settings for a camera and 
cUcks on "update," the effects of the changes occur substantially immediately. If the 
change in camera settings require resetting the camera streamer, such as the case of 
changing the video quality, it is the responsibility of the business objects to inform the 
5 camera manager of the changes and the camera manager will reconnect as required. 
Any current recordings is lost. Scheduled recordings will continue once the camera 
manager has reconnected the streamer. 

Camera Groups. There is a display configured with four Active Video players. 
Each of these Video Players is configured to display live video for a particular camera. 
10 Each video player can also be configured to cycle camera connections. 

The HMI provides the Active Video Player with the cycling timing and camera 
information. 

Schedule Recordings. The schedule recording display provides functionality 
for a user to schedule a recording for a particular camera. 
15 Schedule recordings may be marked as recurring. Li one embodiment, if a user 

selects 9am to 10am on Monday and selects the daily option for 5 days, then a 
schedule is placed fi-om Monday to Friday for 9am to 10am. If the user selects weekly 
for 5 weeks, then a schedule is placed on Mondays 9am to 10am for the next 5 weeks. 
If a user decides to delete a schedule that was created as recurring, then he has 
20 the option to delete all related schedules or just the individual one. 

Intemationalisation. All text that appears on the Avalon web pages is 
preferably retrieved fi"om the video server database. This includes all field labels, text 
within combo boxes and any other "floating" text that may be required on the web 
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pages. Each piece of text will have a specific ID on the web page which is used to 

locate the place in which a text string is to be inserted. 

For example, an ASP page may contain a field with an ID called 

IblCameraName. Server side scripts will call the business objects to obtain the 
5 corresponding text for this field which could be "CameraA". This piece of text may 

be in any language that is supported by the SQL database. It is up to server side 

scripts to fill the HTML elements with the obtained piece of text. In effect, all ASP 

pages is a skeleton of HTML elements. Server side scripts will construct the web page 

through calls to the database manager. 
10 Video Player Control. The Video Player is an ActiveX control responsible for 

(a) Viewing Live Video; 

(b) Viewing Video Clips; 

(c) Providing an interface to the HMI to control the functionality of the 
player; 

15 (d) Generating Windows events for the HMI; 

(e) Displaying Video Information; and 

(f) Cycling Cameras. 

The architecture of the Video Player is detailed in the block diagram of Figure 
29. There it can be seen that the Video Player control is a composite control that is 
20 composed of the following controls 

(a) Video Window Control; and 

(b) Common Slider Control. 

Figure 44 is a table illustrating Video Player Interface Functionality. 
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Control and Information Panes, The Active Video player is a combination of a 
Video Viewing Window and two control and information panes. The control and 
information panes are 

(a) Live Video Pane; and 
5 (b) Playback Pane. 

Video Player - Live. The Active Video Player is able to display live video by 
enabling the Live Video Pane. The following is displayed: 

(a) Video viewing window; and 

(b) Live Video Pane. 
10 The Live Video Pane contains: 

(a) Control Buttons as detailed in Figure 50; 

(b) Record indicator; 

(c) Record duration timer; 

(d) Current Date and Time; 
15 (e) PTZ controls; and 

(f) Zoom and Focus controls. 

Figure. 30 is-a-Screen^dumpjof.a.preferred embodiment of the client display 
screen showing a Video Player in Live mode. Preferably, there are no panes visible 
when the player is placed on the camera group display. 
20 Video Player - Playback. The Active Video Player is able to display video 

clips by enabling the Live Video Pane. The following is displayed: 

(a) Video viewing window 

(b) Playback Pane 
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The Playback pane contains: 

(a) Control Buttons as detailed in the table of Figure 50; 

(b) Slider control for positioning within the current clip; and 

(c) Current playback position timer. 

5 When the Play button is pressed. Online Video is streamed for the current 

date/time location for the configured time frame. Video playback will continue imtil: 

(a) STOP is pressed; or 

(b) End of the currently selected clip. 

Figure 3 1 is a screen dump of a preferred embodiment of the client display 
10 screen showing the Video Player in Playback mode. 

Video Player Events. The Video player is required to notify it's container 
when specified events occur. This is done by generating Windows Events. 

Camera Cycling. The Video Player is able to display a configured number of 
live cameras one after the other. The length of time each camera is displayed is called 
15 the cycle time. There is one cycle time per camera cycle list. 

If a camera to be displayed is disabled, the camera is displayed for 1 second. 
A frame is displayed indicating that the camera is currently disabled. The next camera 
in the cycle list will then be displayed. 

Video Window Control. The Video Window Control performs the following: 
20 (a) Initiates the video streaming via communication with the Camera 

Manager; and 
(b) Renders the video images into a window. 
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Rendering Engine. A rendering engine displays the video file in the Video 
Player Control. The Camera Streamers often supply the video stream in proprietary 
file formats (known as a CODEC). A different rendering engine is preferably used for 
each supported CODEC. 
5 Event Viewer Control. This control displays the following information: 

(a) The playback position in the current time frame of searched stored 
video; 

(b) Location bar - The location of stored video, local or archive, indicated 
via coloured bars; and 

10 (c) Event bar - Symbols indicating the time of alarm/events and snapshots. 

This control provides the following control ability: 

(a) Move to the start of the Next Alarm in the current time frame; 

(b) Move to the start of the Previous Alarm in the current time frame; and 

(c) Selection of an alarm/event or snapshot symbol. The Video Player will 
15 position to the time of the event, not the start of the clip. 

The Event Viewer control is only visible when the Active Video Player is 
configured to display stored video for a single camera. Figure 32 is a screen dump of a 
client display screen showing the preferred Event Viewer Control. 

Only clips whose recording events are contained within the searched time 
20 frame are able to be played. If a pre-record portion of the clip is prior to the start of 
the frame, or the recording continues past the end of the frame, these sections will not 
be able to be accessed. 
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Joystick Client. The joystick client forms part of the camera control 
subsystem. The joystick client software will physically reside on the HMI client PC. 
It is responsible for interfacing to the joystick and sending the joystick commands to 
the Camera Manager on the Avalon server. If appropriate, the camera manager will 
5 forward the request to the camera control subsystem. This is shown in the block 
diagram of Figure 12. 

PlantScape/EBI Server. 

Event Activation. The event activation subsystem will upon an event: 
(a) Cause the Avalon server to record a specified camera; and 
10 (b) Optionally cause a station (or all stations in an area) to switch to view 

the camera page. 

The Event Activation task is an EBI/PlantScape application task and hence 
will reside on the EBI/PlantScape server machine. The interaction of the Event 
Activation task with it's surrounding subsystem is shown in the block diagram of 
15 Figure 17. 

The activation mechanism in one embodiment of the present invention is via 
the use of algorithms. In EBI, Algo71 is used to-request^the-Event Activation task 
when an access point changes states and Algo92 is used when a status point changes 
state. In Plantscape, AlgoTl will request the Event Activation task when a status point 
20 changes state. There is no corresponding algo for access points in Plantscape. 

AVhen the point changes state, the appropriate algo will call the Event 
Activation task passing parameters that are configured when the point was point built. 
Because it is not possible to configure different task request parameters for different 
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states of the points. The same camera record action will occur irrespective of the state 
of the point. 

The Event Activation task will then instruct the camera manager to record the 
camera video, and optionally cause a station (or all stations in an area) to switch to the 
5 camera view. The event description for the event that initiated the event activation is 
also passed to the camera manager. This will allow the camera manager to rdse an 
audit message in Avalon. The Event Activation task will also place an event in the 
event file in Plantscape/EBI. 

Security System Functionality. The security system is responsible for 
10 providing security information that resides in the EBI or Plantscape server database. 
Information that it provides include: 

(a) The name of the operator currently logged into station 

(b) The areas which this operator has access to 

(c) The security and control level of the operator 

15 From this information, the Avalon components can decide whether a user can 

have access to certain functionality provided by Avalon. 

Came£as^e^assigne.d.a£eas.. When a user logs in,_information about the access 
privileges of that user decides how the active tree control is constructed. Any camera 
not within the user's list of areas will not be displayed. 
20 The control level of a user determines whether or not a user has PTZ capability 

enabled for certain cameras. 

The security level of an operator governs the actions that a user can carry out. 
These include whether or not a user can: 
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(a) 



Modify or add new camera settings; 



(b) 



Modify record settings; and/or 



(c) 



Issue record and archive commands. 



A more concise description of the permissions available for a given security 



5 level is shown in the table of Figure 46. 

Configuration Page. A display page is built to configure the URL of the 
Avalon Video Server. This value is stored in a Plantscape/EBI user file. This value is 
used in the configuration of pages that contain navigation buttons to navigate to the 
Avalon displays. 

10 Video Server. 

Video File Structure. Each video clip is stored as a sequence of 1 or more 
segments. A segment contains a sequence of images (frames), and inter-frame timing 
information. The format of each frame is dependent on the source of the video stream. 
For example, if a clip was recorded from an Axis streamer, each frame is in JPEG 

15 format. A segment also contains indexing information that allows the location of a 
particular frame to be rapidly located. For example, playback may be required from 
1 0 seconds Jnto the segment. Indexing provides the file offset for the first frame of the 
playback. 



20 separate files. This is so that during recording of a segment, information can be 
written to the 2 files simultaneously. Playback of a segment may begin while the 2 
files are still being written. 



The index information and the video content of a segment are stored in 2 
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A segment can be referenced by one or more clips. This reduces the amount of 
physical storage required for a number of clips that overlap in time. Figure 33 is a 
block diagram which shows an example of the many-to-many relationship between 
clips and segments. This relationship is described in a number of tables in the Avalon 
5 database. 

Camera Manager. The Camera Manager is responsible for the following 
functionality of the Video Server: 

(a) Camera Streamer Connections; 

(b) Enable/Disable Cameras; 
10 (c) Live Video Streaming; 

(d) Stored Video Streaming; 

(e) Live Video Recording; and 

(f) Camera Control Reservation. 

Camera Streamer Connections. The Camera Manager manages the 
15 connections to the Camera Streamers. This involves both connection and 

disconnection requests. The Camera manager is able to simultaneously stream 
multiple video streams. 

The Camera Manager makes a connection to the Camera Streamer device at 
system startup or when the camera in enabled. If there are no configured pre-record 
20 times, the connection frame rate is at 1 fps. If there are pre-record times greater than 1 
Q)s, then these is used. 

Enable/Disable Cameras. A camera is able to be enabled/disabled via the 
HMI. When a camera is enabled, the camera manager will: 
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(a) Perform any active scheduled tasks; and 

(b) Begin pre-record streaming if required. 

Recordings initiated by a user or a Plantscape/EBI event will not be restarted 
when a camera is enabled. 
5 When a camera is disabled, all operations being performed on the camera are 

cancelled immediately. This includes any form of recording and streaming. 

Live Video Streaming. The Camera Manager Streams Live Video upon the 
first connection request by a client. Streaming is achieved via Multicasting. The 
Camera Manager receives frames from the Camera Streamer and then re-broadcasts 
10 the frames. This broadcasting will stop when no clients are viewing the Camera. 

Stored Video Streaming. The Camera Manager receives requests from Clients 
to play stored video. If the video to be played is not online, then a request is made to 
the Archive Manager to load the video from archive. 

Stored Video is not multicasted. Multiple clients are able to view and control 
15 the same piece of video simultaneously without affecting each other. 

Video Recording. Live Video Recording can be initiated by the following: 

(a) Scheduled Recording - Initiated_by-the Schedule.Manager; 

(b) Event Recording - Initiated by the Event Manager; or 

(c) Manual Recording - Initiated by the User. 

20 Video is recorded to files to be stored on the Video Server. 

The camera manager will add a record in the Video Clips table. 
Camera Control Reservation. The Camera manager is responsible for 
coordinating control of the PTZ functionality. 
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Camera State Object. The Camera State is a COM Automation object 
implemented in a DLL. This object is used by the HMI and Video Player to retrieve 
state information about cameras. The HMI and Video Player should not retrieve this 
state information directly from the Camera Manager. 

5 The Camera Manager sends multicast datagrams whenever an event occurs, 

such as the change in state of a camera. The Camera State object listens for these 
datagrams, and raises a COM event describing the camera event. 

Multicast datagrams are not reliable. That is, there is no guarantee that 
datagrams will arrive at their destination, and there is no guarantee that datagrams will 

10 arrive at the destination in the same order that they were sent. Therefore, the Camera 
State object and Camera Manager implement a simple protocol to allow for lost and 
out-of-order datagrams. This protocol is described in the Camera Manager Software 
Design. 

Camera Control. The camera control subsystem provides a means of 
15 controUing PTZ (Pan/Tilt/Zoom) capable cameras through the Avalon HMI or a 

joystick. Communications to the camera is via a camera streamer. The interaction of 
the camera-control with-the-surrounding-subsystems is.shown in the block diagram of 
Figure 11. 

The Avalon HMI cUent and the Joystick client issue camera control commands 
20 to the Camera Manager. The Camera Manager is responsible for handling priority and 
reservation requests. The Camera Manager may choose to deny camera control 
functionality to a cHent, for example if the camera is currently being controlled by 
another user on another client machine. If permission is granted, the request is 
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forwarded to the Camera Control subsystem. Camera control will then issue the 
necessary commands to the camera streamer to control the camera head. 

Configuration information for the camera control subsystem is stored in the 
Avalon database and provided to the camera control by the Camera Manager when it 
5 is created and initialised. 

The table of Figure 47 details the superset of camera operations. However, the 
actual supported fiinctionahty is dependent on the camera type. 

PTZ commands can be either step or continuous. Step PTZ commands will 
PTZ the camera a fixed increment while continuous PTZ commands start the camera 
10 PTZing, no stop command is sent. It is up to camera control to decide which type of 
PTZ movement it will execute. 

The Continuous PTZ function is used by the joystick for PTZ movement. It 
either does continuous PTZ or returns an error if continuous PTZ is not supported. 

Video Server Database. The video server database is preferably implemented 
15 on the MS SQL Server 7 relational database manager. All database access is via the 
Avalon business objects which use ADO to access the database. 

All text data in the database is stored as a datatype that supports 32 bit Unicode 
characters. This will allow the HMI to store intemationalized strings in the database. 

Referring to Figure 14 there is shown is a fimctionai block diagram illustrating 
20 the Schedule Manager. The Schedule Manager runs as a Windows NT Service and is 
responsible for all scheduled operations in Avalon. 

The schedule manager has two main functions: 

(a) Scheduled video recording; and 
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(b) Scheduled deletion of video clips 

Scheduled Recording Requests. On start up of the Service, the Schedule 
Manager queries the database to determine the record schedules that are currently 
active (i.e. should be currently recording). A record request is sent to the Avalon 
5 Camera Manager for each of these schedules, and each of the associated cameras is 
instructed to begin recording immediately. 

The Camera Manager is responsible for recalculating the record duration 
depending on the actual start up time relative to the scheduled start time of the 
recording. 

10 The Schedule Manager will then periodically run at the boundary of every 

minute and start record schedules that are due to start since the last time it ran. The 
Schedule Manager will inform the Avalon Camera Manager to start recording for each 
recording request due. The Schedule Manager provides the camera manager with the 
Schedule ID. 

1 5 Scheduled Deletion. At the boundary of every minute the Schedule Manager 

queries the database for any video clips whose DeleteDateTime has passed. A request 

is made to the Camera Manager to delete any such clip. 

Other. If the recording and deletion operations take greater than 50 seconds 

(i.e. the poll period) to run, then the Schedule Manager will query the database for any 
20 missed schedules and run these immediately. This event however, is unlikely to 

occur. 

Archive Manager. Archiving of video is preferably performed using the 
Windows2000 Remote Storage subsystem. This subsystem allows the operating 
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system to move files from disk to tape on a least recently used basis. The file still 
appears as a normal file in the file system and is accessible using normal file access 
methods. The operating system will automatically restore the file to disk when it is 
accessed. Since this may take some time, the camera manager will check the status of 
5 a file before opening it and will wam the user if a file is currently on tape. If a file is 
on tape and that tape is not present in the system, the camera manager will generate a 
request for the user to load the correct tape. 

Logging. There are two mechanisms in Avalon for logging of events and 
actions: 

10 (a) Audit Log; and 

(b) Engineering Log. 

The Audit Log provides a means for other subsystems to log user or system 
events to a common storage. Typically these are run time operational events. The 
engineering log is used for engineering, diagnostic and debugging type information. 
15 Audit log messages are structured in fomat, this allows them to be sent to the 

event file in EBI/PlantScape. While Engineering log messages are unstructured text 
strings. 

The maximum size of the audit and engineering log is configurable in the 
database. When a log message is added that would cause the log to exceed it's 
20 maximum size, the oldest message is discarded. 

Audit Log. The audit log subsystem provides a means for other subsystems to 
log user or system events to a common storage. Some of these events may be 
forwarded onto the PlantScape or EBI for inclusion in their event file. 
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Avalon subsystems such as the camera manager and camera control send audit 
messages to the Audit log subsystem. These audit messages are then inserted into a 
log table in the Avalon database. Configuration information in the Avalon database 
will determine whether this information is also forwarded to EBI/Plantscape for 
5 inclusion in its event file. The block diagram for the Audit Log subsystem is shown in 
Figure 19. 

In altemative embodiments, the audit log provides the framework for 
implementing audit traiUng. 

Engineering Log. The engineering log is functionally similar to the audit log 

10 but is used for engineering, diagnostic and debugging type information. Engineering 
messages is free format messages ie unstructured text strings. The log can be written 
locally or remotely via DCOM. This allows a client machine to log locally or to send 
its log messages to a central Avalon log file. The block diagram for the Engineering 
Log subsystem is shown in Figure 20. 

15 Avalon Business Objects. The Avalon Business Objects (ABO) are 

responsible for the management of data access by the user through the HMI and other 
Avalon componentSv-It-contains-applicatioiLspecific logic related to the data services 
required by Avalon. These data services may be broken down into the following 
functional areas: 

20 (a) HMI specific; 



(b) 



Camera specific; 



(c) 



Recorded video; and 



(d) 



Camera group. 
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Wherever possible the business objects will use stored procedures to perform 
its tasks. However, there are cases where straight SQL queries are performed in the 
business objects. Since a major portion of the business objects functionality involves 
the use of disconnected recordsets, updating of these recordsets are performed by 
5 calling the UpdateBatch method on the ADOR recordsets. This method cannot be 
called on recordsets retrieved by stored procedures. 

HMI Specific. This is mainly concerned with the retrieval of information 
required to display the Avalon web pages. This includes retrieving field labels and 
text, combo-box text fields and text used to construct the Active Treeview Control, 
10 header text and-menu items firom the database. All text which appear in a web page is 
obtained through the business objects. 

Camera Specific. This includes data services required to retrieve and update 
the camera settings for a particular camera. It also includes the functionality to delete 
a camera fi-om the database and any associated fields. This may involve a cascade 
15 delete. Likewise, the addition of a new camera into the database will form part of the 
camera specific data services. 

Other functionality required include retrieving and updating any record 
settings associated with a camera and checking that the settings are viable. This 
includes all user activated record settings, event activated record settings and 
20 scheduled record settings. Notifications of the changes to the camera manager will 
also be part of the business object's services. 

The business objects may also request that a camera be disabled or enabled. 
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Recorded Video. This includes any data access functionality required to 
access recorded video in a database. This also covers the searching of recorded video 
in the database based on the search fields a user entered in the HML 

The submission of deletion dates into the database of which the schedule 
5 manager is to respond to when the time arrives will also be done by the business 
objects. 

Camera Group. This includes the database access functionality associated with 
camera groups. This includes any data access required when creating new camera 
groups, editing camera groups or deleting camera groups. 
10 Point Control. The point control component controls a Plantscape/EBI point to 

a controlled state using the Network API. This component resides on the Video 
Server. The server name is obtained from the Video Server Database. Figure 34 is a 
block diagram illustrating Point Control. 

For each block, identify which functions described in the specification is 
15 performed by the block, and the proposed or preferred methods of implementation. 

Interface Description. The following paragraphs describe each of the interface 
types used to connect design components (blocks) discussed in the preceding- 
paragraphs. 

HML 

20 HMI Interface to Business Objects from Server-side Scripts. The HMI obtains 

all HMI related data from the video server database via the business objects. When a 
user navigates to a certain web page, the server side scripts instantiate a business 
object and obtain relevant information to build the web page. This includes obtaining 
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all field labels, text within combo boxes and any other text that may appear on the web 
page. Server side scripts construct the web page based on the information stored in 
the database. 

The component interaction in this case is depicted in Figure 35. 
5 HMI Interface to Business Objects from Client-side Scripts. Figure 36 shows 

the component interaction for the case where client side scripts creates the Avalon 
business objects. In this case, HTML elements are bound to a datasource specified by 
the RDS.DataControl object. The instantiation of the business objects is done by the 
RDS.Dataspace object. This object uses HTTP to communicate (pass recordsets) to 
10 the business objects. Access to the Video Server Database will still be via ADO. 

HMI Interface to the Active Video Player. The HMI is a container for ActiveX 
controls and this is how it is able to display video from the camera streamer. It is the 
Active Video Player which request connection to the camera streamer via the camera 
manager and displays the video that was broadcast onto the LAN. 
15 The HMI is able to capture events from the Active Video Player and cKent side 

scripts will respond to them accordingly. This interaction is shown in Figure 37. 
The HMI does the following: 

(a) Configures the Video Player to stream either live or video clips; 

(b) Sets the camera to stream; and 

20 (c) Sendsastartrequest for live video viewing. 

Video Player Control. The Active Video player provides the following 
interfaces: 

(a) ILive - interface for displaying a live video stream; 
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(b) IClip - interface for displaying video clips; and 

(c) IConfiguration - interface for modifying the Player. 
Video View Window Control. 

Camera Control. The camera control is preferably implemented as a C-h- 

5 classes. 

To create a camera control object, the Camera Manager will firstly create a 
CheadConfig and a CstreamerConfig object using configuration values from the 
Avalon database. These objects contain configuration information for a camera head 
and camera streamer respectively. Camera Manager then calls 
10 CCameraBuilder: iNewCameraQ passing the CheadConfig and CstreamerConfig 
object. A CameraHead object is returned by NewCamera. This object is used by 
camera manager to control the camera. 

Event Activation. As the event activation mechanism uses algo92 and algo71, 
the parameter block that is passed to the Event Activation task is used. 
15 In Older to switch the station view, the camera no. and station no./area are sent 

to the display system. The station no./area identifies the station(s) to switch and the 
camera-no.-identifies.-the.camera.to view. The URL of the Avalon Server is obtained 
fi-om the Avalon User File. 

In order to record video, the camera no., pre-record time and post record time 
20 are sent to the camera manager. For audit logging purposes, the point number, point 
state and event description are also sent. 

Camera Manager. The Camera Manager is preferably implemented by 3 COM 
objects. They are: 
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(a) The CameraManager object provides methods to perform camera 
management operations. Examples of these operations are creation and 
deletion of cameras; 

(b) The Camera object provides methods to perform operations on a 

5 camera. Examples of these operations are recording of live video, and 

deletion of a video clip; and 

(c) The PlaybackStream object provides methods to perform playback of a 
video clip. Operations include pause, resume, step, and setting 
playback position, speed and direction. 

10 The rationale behind implementing the Camera Manager as 3 objects is to 

allow for a system architecture with multiple Video Servers. A single Video Server 
may be configured to manage a subset of all the cameras. In this architecture, to 
create a new Camera object instance, a referral object is used to locate the correct 
Video Server, and to create the new instance on that server. The GetCameraQ method 

15 in the CameraManager object fulfils this role. The location of the Camera object 
instance is transparent to the clients of the CameraManager and Camera objects. 

Schedule Manager. The Schedule Manager does not receive requests or 
messages fi-om any other Avalon subsystem. Task timing is handled internal to the 
schedule manager using Windows NT system calls, 

20 Logging. 

Audit Log. The audit log process provides all other subsystems in Avalon 
with a way of writing an audit log message to a common storage. This log message 
may be forwarded to EBI/Plantscape for inclusion in their event file depending on 
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Avalon configuration details. This is implemented as a function that can be called by 
other subsystems. 

Engineering Log. The engineering log process provides all other subsystems 
in Avalon with a way of writing a log message to a common storage. The engineering 
5 log process is similar to the audit log process. This is implemented as a COM object. 

The Engineering Log object HWDVSLog exposes one interface EngLog. This 
interface exposes three methods - LogMessag, LogCErr and LogNTErr. 

Avalon Business Objects. The business objects preferably have interfaces that 
allow client browsers and other Avalon components to access its functionality. They 
10 preferably also have interfaces to the SQL video server database. 

Client stations (web browsers) can access the business objects either by server 
side scripts on Active Server Pages (ASP) or by HTTP firom client side scripts. Data 
access is achieved through ADO. Other Avalon components requiring database access 
will obtain a COM interface to the business objects. In this case, the transport method 
15 is DOOM. 

The business objects are implemented as an ActiveX DLL. It is composed of 
COM objects that reside in the ActiveX DLL which is in turn registered in the 
Microsoft Transaction Server. The reason for including these objects in MTS is that 
MTS provides a robust environment for multi-user support. MTS provides an 
20 infrastructure that efficiently manages system resources such as threads, processes and 
connections. It also manages object instantiation, execution and deletion. 

In Figure 35, the interaction of the business objects with the video server 
database, other Avalon components and the HMI are shown. This diagram depicts the 
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case whereby the business objects are instantiated by server side scripts in ASP web 
pages. The business objects access the Video Server Database via the ActiveX Data 
Objects (ADO). Other Avalon components may also call methods on the business 
objects by obtaining a COM interface to it. 

5 Figure 35 shows the component interaction for the case where the business 

objects are instantiated by client side scripts via the Remote Data Service objects. In 
this case, the communication between the business objects and the client side RDS 
object is via HTTP. Access to the Video Server Database is still be via ADO. 

Security System Interface. The security system is implemented as a COM 

10 object residing in the EBI/Plantscape server machine. Client machines commimicate 
with it via DCOM as shown in Figure 48. 

Before a web page is loaded, the security settings of the user that logged into 
the Plantscape/EBI machine are firstly investigated. The station nimiber is sent to the 
video server when the web page is processed. Server side scripts create business 

15 objects on the server machine which in tiun checks the security settings. This is done 
by querying a local copy of the area assignment information stored in the Avalon 
database. This information is-updated.each.time-a-user .logsdntO-a cUent machine by a 
call to the security object in the OnOperatorChange script on the client machine. 

The tables which the Security system accesses on the Plantscape/EBI server 

20 are: 

(a) Area Assignment Table - for list of available areas and their 
description; 
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(b) CRT Table - used to obtain the operator number from a given station 
number; and 

(c) Operator Table - used to obtain the security level and control level for 
an operator. 

5 Each of the elements of the present invention are preferably implemented 

using the following Platforms and software: 
Video Server: 

(a) NT 5.x Server; 

(b) SQL Server 7; and 

10 (c) ns. 

Client: The client is preferably a workstation with the following software 
installed: 

(a) Windows NT 4.0 SP5; 

(b) Windows 98; 

1 5 (c) Intemet Explorer 5 ; and 

(d) Station Release 320. 

PlantScape-Server. The PlantScape Server is based on PlantScape Release 

300. 

EBI Server. The EBI Server is based on EBI Release Bronte. 
20 The following paragraphs provide a ftirfher detailed description of the 

preferred embodiment of the present invention. 

Video Integration Functionality. The following paragraphs describe the video 
integration fiinctions which the invention performs. 
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The video integration functionality is preferably implemented through a HMI 
running on a client PC. The Client PC is connected to both the video server and a 
PlantScape/EBI server. 

The video integration functionality can be divided into: 



(b) Recorded video. 

The list of cameras and functions available to a user is dependent on the 
security privileges assigned to that user by the PlantScape/EBI system. All users must 
first connect to either a PlantScape or EBI server before being allowed access to the 
10 video integration HMI. 

The HMI preferably operates within the standard Honeywell Station Release 
320 environment. To support the video HMI the station preferably: 

(a) Uses the SafeBrowse feature of Station; and 

(b) Includes a feature to ensure that the operator station does not timeout if 
15 the operator is viewing one of the live or recorded video pages. 

Live Video. The live output from cameras can be viewed through a series of 
displays. These support: 

(a) Single camera view; 

(b) Modifying settings for a camera; 

20 (c) Modify recording arrangements for a camera; 



5 



(a) 



Live video; and 



(d) 



Group view of up to four cameras; and 



(e) 



Adding and deleting cameras. 



wo 01/13637 PCT/AUOO/00967 



-60- 

Users can select a camera from a tree control listing the cameras available to 
the user. 

Figure 6 is a screen dump of a sample client display screen showing a frame 
captured from a single camera and displayed on a client. The key features of this 
5 display are: 

(a) Navigation panel linking to other Avalon functionality; 

(b) Title bar showing the camera name and description; 

(c) Tabs for live output, settings, recording and schedule details; 

(d) A video object displaying live camera output; 

10 (e) A list ofpreset positions (ifthe camera type supports this 

functionality). Selecting one of tiiese positions will cause the camera 
to automatically carry out the necessary PTZ motions to show the 
position; 

(f) The ability to define preset positions. The preset position has a 20- 
15 character description; 

(g) Details of any other user currently in control of the camera (and how 
much longer they will have control). Users of higher-security, levels-are 
able to take control of the camera at any time (if relevant this is also 
indicated); 

20 (h) Current recording details are shown. If the camera is being recorded 

this is indicated along with the reason for recording, and the time 
remaining for the current recording to complete; 
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(i) A "Recent Recordings" tab takes the user to a search page hsting the 
last 24 hours of video recorded on this camera; and 

(j) "Disable" checkbox. This will stop all video output from the camera as 
well as any video recording. This checkbox can be toggled to 
5 enable/disable the camera stream. 

This display allows the user to: 

(a) View the live output from the selected camera; 

(b) Pan, tilt, zoom and focus the camera using a joystick attached to the 
client PC; 

10 (c) Pan, tilt, zoom and focus the camera using a pointing device attached to 

the client PC. Standard Windows pointing devices such as a mouse or 
touch-screen are supported; 

(d) Manually record a segment of live video. Recording will continue for 
the configured period of. Once recording has begim a button to stop is 

15 highlighted as well as a counter showing the recording time remaining; 

and 

(e) Manually record-a-snapshot-=(single_frame)-from thclive video. 
Camera settings. Figure 49 is a screen dump of a sample client display screen 

showing the live video settings of the preferred embodiment. From this display users 
20 can change important settings for an individual camera. The details are grouped into 
several sections: 

(a) Camera Details; 

(b) Camera Connection; 
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(c) Security; and 

(d) Delete Camera. 

Preferably, only users with the highest level of security (MNGR) are permitted 
to modify camera connection details or delete cameras. 
Camera Details: 

Name A unique name for the camera up to 16 alphanumeric (a to z, A to Z, 

and 0 to 9) characters in length. The name should contain at least one 
alpha character. Spaces, tabs and commas are not valid characters. 
Note: a camera is not a PlantScape/EBI point. Sixteen character point 
names match the capability of PlantScape EBI. 

Location Used by the camera list panel portion of this and other displays to 

group cameras by location. 

Description A 255 alphanumeric character description. 



Camera Connection: 
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Camera Streamer Specify the type of Camera Streamer used to comiect the camera to 
Type the network. The following camera streamer types are supported: 

• OpennetView 

• Axis 2400 

• Axis 2401 

• Prism LAN Camera (stretch goal) 



Camera Type The type of camera connected to the camera streamer. At least the 

following camera types are supported: 

• Pelco Spectra-dome (PTZ capable) 

• Canon VC-C3 (PTZ capable) 

• Fixed (no PTZ capability) 

Resolution Determines the resolution at which the camera output is viewed and 

stored. The available options are: 

640 by 480 pixels 

320 by 240 pixels 

160 by 120 pixels 
Some camera streamer types do not support all of the Usted 
resolutions. The video server can only support those resolutions 
offered by the camera streamer. 
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Determines the frame rate of video displayed on the Live page. The 
supported rates (in frames per second) are: 
30 
25 
20 
15 
10 
7 
5 
3 
2 
1 



1/3 



1/5 
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Host or IP Address Each Camera Streamer has an IP address. The Video Server uses the 

IP address to coraiect to the Camera Streamer. Changing this value 
does not change the value in the Camera Streamer (note: The camera 
streamer IP must be set using the manufacturer instructions). The 
address can either be entered as the raw IP address or as a host name 
(associated with an IP address through standard Windows 
functionality) 

Camera Number Enter the required position of the video input on the Camera Streamer 

if the Camera Streamer supports multiple camera connections. 
For example the Axis 2400 has 4 camera positions 



Security: 

Area PlantScape/EBI area. Used by PlantScape/EBI to determine operator 

security privileges. 

Allows the system to be configured to only allow users to view 
specifiedcameras. 

Refer to PlantScape/EBI documentation for details. 
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Control Level PlantScape/EBI control level. Used by PlantScape/EBI to determine 

operator security privileges. 

Determines if a user is allowed to operate the PTZ controls for a 
camera. Also used to allow higher level users to take control of 
cameras. 

Refer to PlantScape/EBI documentation for details. 

Control Reservation Once a particular user has controlled the camera no other user can 
Period control the camera until this reservation period has expired. 

If this user controls the camera again within the period, the reservation 

period is reset. 

Users with higher security permissions can take control of the camera 
at any time. 

Delete: 

The "Delete" icon allows a user v^th MNGR level security to delete the 
camera from the Video Server. Deleting a camera will delete the record relating to the 
camera from the database. The name of the camera will no longer appear in the list of 
5 cameras. All camera settings is deleted. 

The user is asked if they also wish to delete video clips captured for the 
camera. The default action is to not delete the video clips. If the video clips are not 
deleted they will stay on the video server and archives unless they are later 
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individually deleted. The camera name will also continue to appear in the list of 
cameras used for searching the video clip database. 

If the user chooses to delete video clips captured for the deleted camera, all 
video clips related to the is deleted. The camera name is removed from the list of 
cameras used for searching the video clip database. 

Recording. The Camera Recording Details screen, shown in Figure 50 is used 
to configure the following recording requirements for the camera: 

(a) User activated; and 

(b) Event activated. 

User Activated This section defines parameters particular to user-initiated video 

recording. The user can initiate video recording by viewing live video 
and selecting the •'Record" icon. 
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Pre-Record For The amount of pre-recorded video that is associated with a user 

request for recorded video. This will allow the Video Server to 
capture video prior to the user request, as well as after the request. 



Frame Rate Video quality required for user activated recording 

Record For User activated recordings will terminate after this period. 

The user can choose to extend the individual recording at any time by 
pressing the "record'* button during a recording. This will cause the 
timeout counter (indicating how long till the end of the recording) to 
be reset to the timeout period. 



Retention Period The period that user activated recording is retained by the video server 

before being deleted. 

The retention period of individual clips can be changed from the 
"Search Results" page. 
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Event Activated This section defines parameters particular to alarm/event triggered 

video recording. The following settings are specified for the four 
priorities of events/alarms: 

(a) Event (journal priority); 

(b) Low priority alarms; 

(c) High priority alarms; and 

(d) Urgent priority alarms. 

Note that these following parameters define the maximum possible 
recording parameters for an alarm/event. For example a camera may 
allow pre-recording for events but an individual event on the 
PlantScape/EBI point event may only require a snapshot. 

Pre-Record For The maximum amount of pre-recorded video that can be associated 

with an alarm/event. This will allow PlantScape/EBI events to 
capture associated video prior to the event, as well as after the event. 
This is the maximum amount of pre-alarm recording available to all 
priorities.=Indi5ftiduaLalanns.may be-configured to use lesser amounts 
(or snapshots) of video. 



Frame Rate 



Video quality required. All priorities will use the same quality settin 
(unless the individual event requests a snapshot). 
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Retention period How long the recording is retained by the video server before being 

deleted. Possible selections are: 



(a) 


1 day; 


(b) 


2 days; 


(c) 


3 days; 


(d) 


1 week; 


(e) 


2 weeks; 


(f) 


1 month; 


(g) 


3 months; 


(h) 


6 months; 


(i) 


1 year; or 


(j) 


forever. 



Schedules. Figure 51 is a screen dump of a sample client display screen 
showing the Recording Schedule Configuration of the preferred embodiment. This 
page is used to configure scheduled recordings for the camera. 
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Scheduled Recording A calendar and time control is shown. The user can select a time 

period for a specific day. This will activate a recording on that 
particular day. The user is prompted to type in details of the request 
as well as the recording quality. The user can also specify if this is a 
recurring schedule. Start and stop times can be defined to the minute 
boundary (e.g. 12:48). 

For each scheduled recording the user can select: 

(a) Start; 

(b) Stop; 

(c) Frame rate; 

(d) Retention period; 

(e) Recurrence; and/or 

(f) Description (255 characters). 

Zoom in and out buttons can be used to alter the displayed time 
control resolution. 

Add a new camera. Figure 52 is a screen dump of a sample cHent display 
screen showing this Add a New Camera screen of the preferred embodiment. Using 
this display, users can add new cameras to the Avalon Video Server. The 
functionality of fields on this display is listed in the camera setting section. 
5 Recorded Video. Camera output can be recorded for the following reasons: 

(a) Activated by a PlantScape/EBI alarm or event; 

(b) Manually activated by a user viewing a live camera; or 
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(c) Scheduled recording. 

Event activated recording is a process that allows a segment of video or a 
snapshot to be associated with a PlantScape/EBI alarm or event. 

User activated recording occurs when a user viewing the "Live Video" page 
5 chooses to record the currently viewed camera output by selecting the "Record" 
button. 

Scheduled recording allows video to be recorded between start and stop times 
on defined days. 

Recorded video is stored on the Video Server. The Avalon HMI is able to 
10 query the Video Server to locate relevant recorded video and to then replay that video. 

Search. The display shown in Figure 53 allows a simple search of all video 
recorded on the Video Server. The user selects the time indicator which shows a 
calendar and time line. The user selects the required search period. 

Once the time criterion is entered the "search" is selected. Video recorded 
1 5 during the selected period is returned by the search. 

The user can search on combinations of cameras by clicking on the "Advanced 
Search" icon as disclosed below. 

Advanced Search. Figure 54 is a screen dump of a sample client display 
screen showing the Advanced Search Of Recorded Video screen of the preferred 
20 embodiment. Thisdisplay allows for an advanced search of recorded video. The 
search is based on time and recording. 

The user can select from the list of cameras on the video server. It also 
includes any cameras that have been deleted from the video server but still have video 



wo 01/13637 PCT/AUOO/00967 



-73- 

stored on the video server or on archived media. If a camera has been deleted and all 
video associated with the camera has been deleted, the camera name will not appear in 
this list. 

The time criterion is selected from a calendar and time line control. Days 
5 containing recorded video are shown in bold on the calendar control. Cameras can be 
added and removed from the search list. 

The user can choose to filter the search based on the following criteria: 

(a) Alarm or event type; 

(b) Recording type (schedule, event, operator, all); 
10 (c) Area; 

(d) Point name; 

(e) Event description; or 

(f) Operator name. 

Wildcards are accepted for the Point ID, description, area, level and value. 
15 Selecting the "Search" button will start the search. The results are shown in 

following section. 

Search-Results. Eigure SSJs^a screen dump of a sample client display screen 
showing the Search Results screen of the preferred embodiment. This page shows the 
results of the basic and advanced searches. If the user has accessed this page from the 
20 "Recent Recordings" button on the Live Video page then the results will list 
recordings on a single camera in the last 24 hours (Figure 3.2.2.3-2). 

The user is able to select columns within the list of selected events to sort the 

output. 
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The following features appear on this page: 
Video Player Shows the recorded video segment. 



Clip Details 



Lists all events relevant to the selected time window. As the slide bar 
moves along the time line a cursor will highlight any current alarms 
and events. 



fBpiay 



Will cause the video clip referenced in the Selected Video Clip box to 
play from the current slide bar position. 



I "J Stop 



Will terminate playing and move the slide bar position to the start of 
the video clip. 



ULI Pause 



Will halt playing of the current video clip. Subsequently selecting the 
Play button will commence playing from the current position. 



> Step Forward Can be used once tfie stop or pause buttons have been selected. Will 
cause the displayed video to be advanced one frame. 



3 Step Backward ^® ^^^^ ^^^^ *® ^^^P pmse buttons have been selected. Will 

cause the displayed video to move back one frame. 
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Play the video at an accelerated rate (in general five times the normal 
speed, while only displaying every fifth frame) in the backward 
direction. 



^ Fast Backward ^^^^ video at an accelerated rate (in general five times the normal 

speed, while only displaying every fifth firame) in the forward 
direction. 



The following fields appear in the event detail box: 

Date/Time Date and time of the event. This is the time at which the event was 

recorded on the PlantScape/EBI server. 

Duration The total time firom pre-alarm to post-alarm during which video was 

recorded for this event. Snapshots is listed as 0 seconds. 

Alarm/Event Alarm or Event and the priority. 

Point ID The name of the PlantSc^e/EBI point that triggered the event capture 

Description The alarm line description firom PlantScape/EBI. 
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Value The value associated with the alarm/event (e.g. FADL.) 

Deletion Date The date this video clip is automatically deleted from the system. 

The following button also appears on the screen: 

Delete This icon allows a MNGR level user to delete the video clip from the 

Video Server database. 

Deletion means that all references to the video clip are removed and 
subsequent searches will not find reference to the clip. 

Note: 

The page contains a note section. This will show the notes for 
the selected event. The user can edit the notes to add additional 
5 comments. The notes for scheduled recording will also be 

shown and can also be edited. 
Alann/Event Based Video Recording and-MonitoriSwitching. - PlantSGape/EBI 
events and alarms can trigger video recording and automatically switch camera output 
to specified monitors. This version of Avalon will rely on host based activation using 
10 the existing algorithm structure. 

The following PlantScape/EBI point types can generate alarms and events that 
can trigger video capture in the Video Server and switch monitors: 

(a) Analogue (in one embodiment alarms are mapped to Status points); 
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(b) Status; 

(c) Accumulator (in one embodiment alarms are mapped to Status points); 

(d) Access; and 

(e) CDA (in one embodiment alarms are mapped to Status points). 

5 Event Triggered Recording - Algorithm Version. This version uses the 

queued task request algorithms. These can be activated from any state of a 
PlantScape/EBI point and are described in detail in the PlantScape/EBI 
documentation. The following information can be entered for each point with the 



algorithm attached: 



10 


(a) 


Activation states; 




(b) 


Capture snapshots or video; 




(c) 


If video capture then; 




(d) 


Pre-alarm record time; 




(e) 


Post-alarm record time; and 


15 


(0 


Station or area number if automatic display on a monitor is required 
(similar to the Status Change Display Request algorithm). 



The^algorithm entersian^event in the Event Summary indicating that video is 



being captured on the video server. 

Quad Camera View. A camera group consists of up to four related cameras 
20 viewed on a single display. Figure 7 shows the display screen of Figure 6 showing 
multiple frame captures from multiple cameras; 
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The quad camera view is divided into four quadrants. For each quadrant the 
view can have a camera or be blank. Within each quadrant the view can be configured 
to cycle between a number of cameras. 

Configuring a Camera Group. Figure 56 is a screen dump of a sample client 
5 display screen showing the Camera Group Settings screen of the preferred 
embodiment. 

Quad View Name. A unique name for the quad camera view up to 16 
alphanumeric (a to z, A to Z, and 0 to 9) characters in length. The name should 
contain at least one alpha character. Spaces, tabs and commas are not valid characters. 
10 Camera List. A list of all the cameras on the system (based on the user's 

security details). The user selects a camera name and then adds it to one of the 
quadrants. If more than one camera is placed in a quadrant then the display will cycle 
between the cameras in the list at the configured "Cycle Time". 



15 resources. For this reason the abihty to support multiple video streams on a single 
page has been limited, in this preferred embodiment, to a maximum of four cameras. 

User Audit Trail. It is a requirement of high security sites that all user actions 
on the Avalon HMI be recorded in a log file as well as the PlantScape/EBI event file. 
User actions include: 

20 (a) Interventions such as manual recording and changing settings; 



Decompressing and playing video requires substantial CPU processing 



(b) 



Display pages visited; and 



(c) 



Video clip replays. 
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The log of user actions shall be available in text format on the video server. 
The log file preferably uses the same method as the PlantScape log file (i.e. loga and 
logb files). 

Viewing Cameras fi^om PlantScape/EBI Custom Schematics. Displays on 
5 PlantScape/EBI clients are built using Display Builder. The Display Builder 
SafeBrowse object can be used to place web pages in displays. 

Every time changes to the camera settings are made, the video server will 
create a web page containing the live output of the camera. The SafeBrowse object 
can access this web page. A page shall also be available to support PTZ controls via a 
10 mouse on the custom display. 

PerformanQe. The following paragraphs describe the performance levels 
achieved by the present invention. 

The following figures present a guide to the expected disk space and 
bandwidth usage for a single camera connected to an Avalon server. These can be 
15 extrapolated linearly for multiple cameras. 

The practical cE^acity of an Avalon server appear to be approximately: 

(a) Network bandwidth of 60 Mbits per second; and 

(b) Disk writing of 1 Mbytes per second. 

The nresent invention, at least in its oreferred forms, nrovides a novel 
20 mechanism for using a computer communications network, such as a LAN or WAN, 
to stream video signals between cameras and computer clients requiring that video. In 
the preferred form, the use of event triggering to push a video stream to an interested 
client computer provides a flexible, powerfiil tool for security and process control 
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applications, especially when used in an integrated security and process control 
network environment. For these reasons, the invention provides a commercially 
significant improvement over prior art systems. 
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CLAIMS:- 

1 . A digital video management system including: 
a video server; 

a plurality of cameras; and 
5 at least one client computer terminal, all linked via a computer 

communications network, wherein said video server receives video signals from said 
cameras, and provides said video signals to said client, via said network. 

2. A system according to claim 1 wherein said server provides one or more of: 
(a) live video signals; and 

10 (b) previously recorded video signals; 

to said client in real time. 

3. A system according to either one of claims 1 or 2 wherein one of said cameras 
is a recording camera providing live video signals to said video server via said 
network and wherein whilst said video server is receiving those live video signals 

1 5 from said recording camera it simultaneously provides to any client: 

(a) live video signals from said recording camera; and 

(b) video signals which have been previously-recorded frQm-saida:ecording 
camera. 

4. A system according to any one of the preceding claims wherein said video 
20 server receives recording commencement commands from said client and 

instantaneously commences storing the appropriate video signals. 
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5. A system according to any one of the preceding claims wherein said video 
server stores at least some of said video signals on storage media associated with said 
server. 

6. A system according to claim 5 wherein said video server stores at least some of 
5 said live video signals on said storage media in response to a video recording trigger. 

7. A system according to claim 6 wherein said video recording trigger is one or 
more of 

(a) a schedule; 

(b) , an event; or 

10 (c) an operator action. 

8. A system according to claim 7 wherein said schedule is provided to said video 
server by said client. 

9. A system according to claim 7 or claim 8 wherein said operator action is 
provided to said video server by said client. 

15 10. A system according to any one of claims 7 to 9 wherein said system further 
includes a security system and wherein said event is provided to said video server by 
said security system. 

11. A system according to any one of claims 7 to 10 wherein said event occurs at 
an event time and wherein, when said video server stores at least some of said live 
20 video signals on said storage media in response to said event recording trigger, said 
server stores those live video signals received one or more of: 

(a) at said event time; 

(b) during a pre-event time buffer period; or 
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(c) during a post-event time buffer period. 

12. A system according to claim 1 1 wherein said pre-event time buffer period and 
said post-event time buffer period are configurable. 

13. A system according to claim 12 wherein said buffer periods are configurable 
5 one or more of: 

(a) on a per camera basis; 

(b) on a per area/point basis; or 

(c) on an event-type basis. 

14. A system according to any one of claims 5 to 13 wherein said storage media 
10 includes one or more of: 

(a) a hard disk; 

(b) network storage media; or 

(c) off-line storage media. 

15. A system as claimed in claim 14 wherein said video server archives previously 
15 stored video signals to said off-line storage media. 

16. A system according to claim 14 or claim 15 wherein said video server retrieves 
archived-video si^ials ftom said off-line media. 

17. A system according to any one of the preceding claims wherein said video 
server transmits previously stored video signals to said clients. 

20 18. A system according to any one of claims 10 to 17 wherein said security system 
is a security and access system. 

19. A system according to claim 18 wherein said security and access system is an 
Enterprise Buildings Integrator (EBI) system. 
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20. A system according to claim 18 or claim 19 wherein said client integrates into 
said security system's user interface in an apparently seamless manner. 

21 . A system according to claim 20 wherein said system further includes at least 
one controller linked to said network. 

5 22. A system according to claim 21 wherein said controller includes one or more 
of: 

(a) an access controller; 

(b) a security controller; 

(c) an asset management controller; 
10 (d) a fire controller; or 

(e) an HVAC controller. 

23. A system according to either one of claims 21 or 22 wherein said access 

controller controls whether certain types of information or video signals can be viewed 

or altered by a particular user. 
15 24. A system according to any one of claims 6 to 23 wherein each video signal has 

a corresponding video signal identifier and wherein, when said video server stores that 

video signal, it also stores that video signal's corresponding identifier. 

25. A system according to claim 24 wherein said video signal identifiers include 

one or more of: 
20 (a) a user-defined name; 

(b) a start time; 

(c) an end time; 

(d) a duration; 
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(e) camera information; 

(f) trigger information; 

(g) user comments; or 

(h) storage priority information. 

5 26. A system according to claim 24 or claim 25 wherein said video signal 
identifiers are stored in a searchable relational database on said storage media and 
wherein said client includes a search and retrieval interface which receives user 
supplied searching criteria, and wherein when said client receives said criteria it 
forwards said criteria to said video server whereupon said video server searches said 

10 relational database and locates those video signal identifiers which satisfy said criteria 
and identifies them to said client. 

27. A system according to claim 26 wherein said client displays those identified 
video signal identifiers. 

28. A system according to claim 27 wherein said video server receives a video 

15 signal request fi-om said client and retrieves that video signal fiom said storage media 
and provides it to said client. 

29. A system according to any one of the preceding claims:Ayhei:ein;5aid:.computer 
communications network is a TCP/IP network. 

30. A system according to any one of the preceding claims wh^ein said network 
20 fiirther includes a network switch. 

31. A system according to claim 30 wherein said video server is positioned on one 
side of said network switch between said cameras and said network switch. 
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32. A system according to claim 3 1 wherein said security and access server is 
positioned on the other side of said network switch, between said client computer 
terminal and said network switch. 

33. A system according to any one of the preceding claims wherein said video 
5 server requests and receives live video signals from said cameras. 

34. A system according to claim 33 wherein said video server unicasts and 
multicasts live video signals to single and multiple clients respectively via said 
network. 

35. A system according to claim 33 or claim 34 wherein said video server receives 
10 camera control commands from said client and forwards said conunands to said 

cameras. 

36. A system according to any one of the preceding claims wherein said client 
computer terminal displays live video signals and pre-recorded video signals. 

37. A system according to claim 36 wherein said client provides camera adding 
15 commands and camera configuring commands to said video server, in order to add 

new cameras and configure existing cameras. 

38. A system=accGrdin&.ta.claim3j6-or claim-37 wherein said client selectively 
displays video signals in response to user requests. 

39. A system according to claim 38 wherein said client displays one or more of 
20 said video signals simultaneously. 

40. A system according to claim 39 wherein said client displays said video signals 
in single or quad views. 
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41 . A system according to any one of the preceding claims wherein said client one 
or more of: 

(a) displays any cameras available for viewing in a tree structure; 

(b) provides for online adjustment of a plurality of camera parameters; 

5 (c) displays small, medium or large views of video signals provided by any 

of said cameras; 

(d) displays camera groupings; 

(e) displays a quad view of video signals provided by four different 
cameras; 

10 (f) displays video signals provided by different cameras in a timed 

sequential pattern; 

(g) displays video signals on multiple monitors; 

(h) provides direct recording control of any camera; 

(i) displays a listing of all recorded video signals; 

15 (j) provides for easy retrieval of previously recorded video signals; 

(k) provides PTZ control of any camera; or 
(i) displays video signals at a variety of frame rates. 

42. A system according to any one of the preceding claims wherein each of said 
cameras is linked to said network via a camera manager. 

20 43. A system according to claim 42 wherein said cameras are analogue cameras, 
producing analogue camera signals and wh^ein said camera manager converts said 
analogue camera signals into digital video signals. 
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44. A system according to claim 42 or claim 43 wherein said camera manager 
streams said digital video signal onto said network. 

45. A system according to any one of claims 42 to 44 wherein said camera 
manager receives camera control commands from said video server and outputs said 

5 commands to its corresponding camera. 

46. A system according to any one of claims 42 to 45 wherein said camera 
manager is a camera streamer. 

47. A system according to claim 46 wherein said camera streamer is one of: 
(a) an Axis Conmiunications 2401 camera streamer; 

10 (b) a Mega Chips OpennetView camera streamer; or 

(c) an Axis Conmiunications 2400 camera streamer, 

48. A system according to any one of the preceding claims wherein said cameras 
include one or more of: 

(a) a standard NTSC closed circuit television camera with coax video; 
15 (b) a Pelco pan tilt zoom (PTZ) camera; 

(c) a cannon VC-C3 PTZ camera; or 

(d) an American Dynamics Speed Dome PTZ camera. 

49. A method of managing digital video using a digital video management system 
including: 

20 a video server; 

a plurality of cameras; and 

at least one client computer terminal, all linked via a computer 
communications network, wherein said method includes the steps of: 
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(a) sending video signals from said cameras to said video server; 

(b) providing said video signals from said video server to said client, via 
said network. 

50. A method according to claim 49 wherein said server performs the steps of 
5 providing one or more of: 

(a) live video signals; and 

(b) previously recorded video signals; 
to said client in real time. 

51. A method according to either one of claims 49 or 50 wherein one of said 
10 cameras is a recording camera providing live video signals to said video server via 

said network and wherein whilst said video server is receiving those live video signals 
from said recording camera it simultaneously performs the steps of providing to any 
client: 

(a) live video signals from said recording camera; and 
15 (b) video signals which have been previously recorded from said recording 

camera. 

52. A method according to any one of clainiS-49 to_5-l.wheEeia:;said-video. server 
performs the steps of: 

(a) receiving recording conunencement commands from said client; and 
20 (b) commencing storing the appropriate video signals instantaneously. 

53. A method according to any one of claims 49 to 52 wherein said video server 
performs the step of storing at least some of said video signals on storage media 
associated with said server. 
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54. A method according to claim 53 wherein said video server performs the step of 
storing at least some of said live video signals on said storage media in response to a 
video recording trigger. 

55. A method according to claim 54 wherein said video recording trigger is one or 
5 more of: 

(a) a schedule; 

(b) an event; or 

(c) an operator action. 

56. A method according to claim 55 wherein said client performs the step of 
10 providing said schedule to said video server. 

57. A method according to claim 55 or claim 56 wherein said client performs the 
step of providing said operator action to said video server. 

58. A method according to any one of claims 55 to 57 wherein said system further 
includes a security system and wherein said security system performs the step of 

1 5 providing said event to said video server. 

59. A method according to any one of claims 55 to 58 wherein said event occurs at 
an event timCkand^wJierein, when said-video-serv^ performs the step of storing at least 
some of said live video signals on said storage media in response to said event 
recording trigger, said server stores those live video signals received one or more of: 

20 (a) at said event time; 

(b) during a pre-event time buffer period; or 

(c) during a post-event time buffer period. 
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60. A method according to claim 59 wherein said pre-event time buffer period and 
said post-event time buffer period are configurable. 

61 . A method according to claim 60 wherein said buffer periods are configurable 
one or more of: 

5 (a) on a per camera basis; 

(b) on a per area/point basis; or 

(c) on an event-type basis. 

62. A method according to any one of claims 53 to 61 wherein said storage media 
includes one or more of: 

10 (a) a hard disk; 

(b) network storage media; or 

(c) off-line storage media. 

63. A method according to claim 62 wherein said video server performs the step of 
archiving previously stored video signals to said off-line storage media. 

15 64. A method according to claim 62 or claim 63 wherein said video server 
performs the step of retrieving archived video signals from said off-line media. 

65. A-method according to any one of claims 49 to 64wherein said video server 
performs the step of transmitting previously stored video signals to said chents. 

66. A method according to any one of claims 58 to 65 wherein said security 
20 system is a security and access system. 

67. A method according to claim 66 wherein said security and access system is an 
Enterprise Buildings Integrator (EBI) system. 
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68. A method according to claim 66 or claim 67 wherein said client performs the 
step of integrating into a user interface of said security system in an apparently 
seamless manner. 

69. A method according to claim 68 wherein said system further includes at least 
5 one controller linked to said network. 

70. A method according to claim 69 wherein said controller includes one or more 

of: 

(a) an access controller; 

(b) a security controller; 

10 (c) an asset management controller; 

(d) a fire controllCT; or 

(e) an HV AC controller. 

71 . A method according to either one of claims 69 or 70 wherein said access 
controller performs the step of controlling whether certain types of information or 

15 video signals can be viewed or altered by a particular user. 

72. A method according to any one of claims 54 to 70 wherein each video signal 
has a corresponding video signal identifier and wherein, when said video server 
performs the step of storing that video signal, it also performs the step of storing that 
video signal's corresponding identifier. 

20 73. A method according to claim 72 wherein said video signal identifiers include 
one or more of: 

(a) a user-defined name; 

(b) a start time; 
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(c) 



an end time; 



a duration; 



(e) 



camera information; 



trigger information; 



5 (g) user comments; or 

(h) storage priority information. 
74. A method according to claim 72 or claim 73 wherein said video signal 
identifiers are stored in a searchable relational database on said storage media and 
wherein said cUent includes a search and retrieval interface which performs the step of 

1 0 receiving user supplied searching criteria, and wherein when said cUent receives said 
criteria it performs the step of forwarding said criteria to said video server whereupon 
said video server performs the step of searching said relational database and locates 
those video signal identifiers which satisfy said criteria and then performs the step of 
identifying them to said client. 

15 75 . A method according to claim 74 wherein said client performs the step of 
displaying those identified video signal identifiers. 

76. A method according to claim 75 wherein said-video^servenperforms-the step of 
receiving a video signal request fi-om said client and retrieving that video signal from 
said storage media and providing it to said client. 
20 77. A method according to any one of claims 49 to 76 wherein said computer 
communications network is a TCP/IP network. 

78. A method according to any one of claims 49 to 77 wherein said network 
further includes a network switch. 
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79. A method according to claim 78 wherein said video server is positioned on one 
side of said network switch between said cameras and said network switch. 

80. A method according to claim 79 wherein said security and access system is 
positioned on the other side of said network switch, between said client computer 

5 terminal and said network switch. 

81. A method according to any one of claims 49 to 80 wherein said video server 
performs the steps of requesting and receiving live video signals from said cameras. 

82. A method according to claim 81 wherein said video server performs the steps 
of unicasting and multicasting live video signals to single and multiple clients 

10 respectively via said network. 

83. A method according to claim 81 or claim 82 wherein said video server 
performs the steps of receiving camera control commands from said client and 
forwarding said commands to said cameras. 

84. A method according to any one of claims 49 to 83 wherein said client 

1 5 computer terminal performs the step of displaying hve video signals and pre-recorded 
video signals. 

85. A-method^according-to-claim 84-wherein_said client performs the step of 
providing camera adding commands and camera configuring commands to said video 
server, in order to add new cameras and configure existing cameras. 

20 86. A method according to claim 84 or claim 85 wherem said client performs the 
step of selectively displaying video signals in response to user requests. 
87. A method according to claim 86 wherein said client performs the step of 
displaying one or more of said video signals simultaneously. 
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88. A method according to claim 87 wherein said client performs the step of 
displaying said video signals in single or quad views. 

89. A method according to any one of claims 49 to 88 wherein said client performs 
one or more of: 

5 (a) displaying any cameras available for viewing in a tree structure; 

(b) providing for online adjustment of a plurality of camera parameters; 

(c) displaying small, medium or large views of video signals provided by 
any of said cameras; 

(d) displaying camera groupings; 

[0 (e) displaying a quad view of video signals provided by four different 

cameras; 

(f) displaying video signals provided by different cameras in a timed 
sequential pattern; 

(g) displaying video signals on multiple monitors; 

1 5 (h) providing direct recording control of any earner^ 

(i) displaying a listing of all recorded video signals; 
(j) providing for easy retrieval of previously recorded video signals; 
(k) providing PTZ control of any camera; or 
(i) displaying video signals at a variety of frame rates. 

20 90. A method according to any one of claims 49 to 89 wherein each of said 
cameras is linked to said network via a camera manager. 
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91 . A method according to claim 90 wherein said cameras are analogue cameras, 
producing analogue camera signals and wherein said camera manager performs the 
step of converting said analogue camera signals into digital video signals. 

92. A method according to claim 90 or claim 91 wherein said camera manager 
5 performs the step of streaming said digital video signal onto said network. 

93. A method according to any one of claims 90 to 92 wherein said camera 
manager performs the steps of receiving camera control commands from said video 
server and outputting said commands to its corresponding camera. 

94. A method according to any one of claims 90 to 93 wherein said camera 
10 manager is a camera streamer. 

95. A method according to claim 94 wherein said camera streamer is one of: 

(a) an Axis Communications 2401 camera streamer; 

(b) a Mega Chips OpennetView camera streamer; or 

(c) an Axis Communications 2400 camera streamer. 

15 96. A method according to any one of claims 49 to 95 wherein said cameras 
include one or more of: 

(a) a standard NTSC closed circuit television camera withxoax. video; 

(b) a Pelco pan tilt zoom (PTZ) camera; 

(c) a caimon VC-C3 PTZ camera; or 

20 (d) an American Dynamics Speed Dome PTZ camera, 

97, A system for low-latency remote video monitoring of one or more areas or 
processes of interest, the system including: 
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a plurality of cameras positioned respectively at or adjacent the areas or 
processes of interest, each of the cameras outputting a video signal; 

interface means connecting the cameras to a computer communications network, 
for placing the respective video signals onto the computer communications network; 
5 a first computer server connected to a computer communications network, for 

accepting the video signals from the interface means; and 

at least one computer terminal connected to the computer communications 
network for selectively monitoring one or more of the video signals via the first 
computer server. 

10 98. A system according to claim 97, wherein one or more of the cameras are digital 
cameras. 

99. A system according to claim 97 or 98, further including a control interface 
linking the computer communications network with some or all of the cameras, the 
computer terminal being configured to control one or more aspects of each of the 

15 cameras linked via the control interface. 

100. A system according to claim 99, wherein control of the video cameras is 
implemented by control signals generated by^the.first_computer server in re^onse to 
software instructions communicated from the computer terminal. 

101. A system according to claim 99 or 100, wherein the aspects of the cameras 
20 controlled by the computer terminal include one or more of: 

panning; 

zooming; 

tilting; 
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image focusing; and 

powering a camera up or down, or placing it into a "standby" mode; 

102. A system according to any one of claims 97 to 101, the system being configured 
to enable the computer terminal to display live video data from one or more of the 

5 cameras. 

103. A system according to any one of claims 97 to 102, wherein some or all of the 
video signals from the cameras are recorded on storage means associated with the first 
computer server. 

1 04. A system according to claim 103, wherein the video signals recorded on the 
10 storage means are selectively retrievable upon instructions from the computer 

terminal, for display on the computer terminal. 

105. A system according to claim 103 or claim 104, wherein the video signal from 
one or more of the cameras is recorded over one or more predetermined time intervals. 

106. A system according to claim 105, wherein the one or more time intervals are 
15 preset ahead of time via the computer terminal. 

107. A system according to any one claims 97 to 106, ftirther including one or more 
transducers-assaciated.with.atJeast one otthe cameras, each transducer providing a 
transducer output signal, wherein the system is configured such that, upon change of a 
value of a predetermined transducer output signal, a predetermined camera or cameras 

20 associated with the associated transducer is selected for viewing on ttie computer 
terminal and/or recorded on storage means associated with the first computer server. 

108. A digital video management system substantially as described herein with 
reference to the accompanying drawings. 
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109. A method of managing digital video using a digital video management system 
substantially as described herein with reference to the accompanying drawings. 

110. A system for low-latency remote video monitoring of one or more areas or 
processes of interest substantially as described herein with reference to the 

5 accompanying drawings 

111. [NEW CLAIM] A digital video management system including: 

a plurality of cameras for providing respective first video signals to a computer 
communications network; 

a video server for linking to the network, receiving the first video signals and 
10 being responsive to a predetermined schedule for storing on storage media associated 
with the server at least some of the first video signals, wherein the server selectively 
accesses the stored signals and/or the first video signals to provide second video signals; 

at least one client computer temiinal for linking to the network for providing 
the predetermined schedule and for receiving the second signals. 
15 112. [NEW CLAIM] A system according to claim 1 1 1 wherein the 

predetermined schedule includes a plurality of time based trigger points and the server 
stores the first images starting at a first predetermined period prior to each point and a 
second predetermined period after each point. 

113. [NEW CLAIM] A system according to claim 1 1 1 wherein the 
20 predetermined schedule includes a plurality of event based trigger points and the 

server stores the first images starting at a first predetermined period prior to each point 
and a second predetermined period after each point. 
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1 14. [NEW CLAIM] A system according to claim 1 12 including a sensor for 
providing a third signal to the network, wherein one of the event based trigger points 
comprises the third signal falling within a predetermined range. 

115. [NEW CLAIM] A system according to claim 1 1 1 wherein the 
5 predetermined schedule includes a plurality of time based trigger points and the server 

stores the first images starting at a first predetermined period prior to each point and a 
second predetermined period after each point. 

1 1 6. [NEW CLAIM] A system according to claim 1 1 5 wherein the first and 
the second predetermined periods are configurable based upon one or more of: on a 

10 per camera basis; on a per area basis; on an event type basis. 

1 1 7. [NEW CLAIM] A system according to claim 115 wherein the duration 
of the first and the second predetermined periods are configurable. 

118. [NEW CLAIM] A system according to claim 1 1 1 including a plurality of 
client terminals and a controller for controlling the second signals that are provided to 

15 respective terminals. 

1 1 9. [NEW CLAIM] A system according to claim 1 1 8 wherein the terminals 
provide over the network respective camera control commands to the video server and 
the video server processes those commands and generates control signals that are sent 
to the relevant camera via the network. 

20 120. [NEW CLAIM] A system according to claim 1 1 8 wherein the processing 
of the commands by the video server includes a determination of whether or not the 
terminal sending the respective command has access rights to the relevant camera. 
121 . [NEW CLAIM] A digital video management system including: 
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>^ ■'ll^' ^ a plurality of cameras for providing respective first video signals to a computer 



communications network; 

a video server for linking to the network, receiving the first video signals and 
storing on storage media associated with the server at least some of the first video 
5 signals, wherein the server is responsive to a plurality of cUent account records for 
accessing the first signals and/or the stored signals to selectively produce a plurality of 
second video signals; and 

a plurality of client computer terminals corresponding to each client access 
record, the terminals being linked to the network for requesting and receiving 
10 respective second signals. 

122. [NEW CLAIM] A system according to claim 121 wherein at least some of 
the client account records are changeable via the respective client computer terminal. 

123. [NEW CLAIM] A system according to claim 121 wherein the cUent 
account records include data indicative of the one or more first signals and/or stored 

15 signals that the server is responsive to when producing the respective second signals. 

124. [NEW CLAIM] A system according to claim 121 wherein the client 
account records include data indicative of one or more predetermined triggers. 

125. [NEW CLAIM] A system according to claim 124 wherein the trigger is 
one or more of: a predetermined time; a predetermined interval; and an event. 

20 126. [NEW CLAIM] A system according to claim 125 wherein the event is 
predicated by a transducer that provides an event signal to the video server via the 
network. 
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